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Preface 


The Agency for Healthcare Research and Quality (AHRQ), through its Evidence-based 
Practice Centers (EPCs), sponsors the development of systematic reviews to assist public- and 
private-sector organizations in their efforts to improve the quality of health care in the United 
States. These reviews provide comprehensive, science-based information on common, costly 
medical conditions, and new health care technologies and strategies. 

Systematic reviews are the building blocks underlying evidence-based practice; they focus 
attention on the strength and limits of evidence from research studies about the effectiveness and 
safety of a clinical intervention. In the context of developing recommendations for practice, 
systematic reviews can help clarify whether assertions about the value of the intervention are 
based on strong evidence from clinical studies. For more information about AHRQ EPC 
systematic reviews, see https://effectivehealthcare.ahrq.gov/about/epc/evidence-synthesis. 

AHRQ expects that these systematic reviews will be helpful to health plans, providers, 
purchasers, government programs, and the health care system as a whole. Transparency and 
stakeholder input are essential to the Effective Health Care Program. Please visit the Web site 
(www.effectivehealthcare.ahrq.gov) to see draft research questions and reports or to join an e- 
mail list to learn about new program products and opportunities for input. 

If you have comments on this systematic review, they may be sent by mail to the Task Order 
Officer named below at: Agency for Healthcare Research and Quality, 5600 Fishers Lane, 
Rockville, MD 20857, or by email to epc@ahrq.hhs. gov. 


Gopal Khanna, M.B.A. Arlene Bierman, M.D., M.S. 

Director Director 

Agency for Healthcare Research and Quality Center for Evidence and Practice 
Improvement 


Agency for Healthcare Research and Quality 


Stephanie Chang, M.D., M.P.H. Suchitra Iyer, Ph.D. 

Director Task Order Officer 
Evidence-based Practice Center Program Center for Evidence and Practice 
Center for Evidence and Practice Improvement Improvement 


Agency for Healthcare Research and Quality Agency for Healthcare Research and Quality 
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Interventions for Substance Use Disorders in 
Adolescents: A Systematic Review 


Structured Abstract 


Objectives. This systematic review (SR) synthesizes the literature on behavioral, pharmacologic, 
and combined interventions for adolescents ages 12 to 20 years with problematic substance use 
or substance use disorder. We included interventions designed to achieve abstinence, reduce use 
quantity and frequency, improve functional outcomes, and reduce substance-related harms. 


Data sources. We conducted literature searches in MEDLINE, the Cochrane CENTRAL Trials 
Registry, Embase, CINAHL, and PsycINFO to identify primary studies meeting eligibility 
criteria through November 1, 2019. 


Review methods. Studies were extracted into the Systematic Review Data Repository. We 
categorized interventions into seven primary intervention components: motivational interviewing 
(MI), family focused therapy (Fam), cognitive behavioral therapy (CBT), psychoeducation, 
contingency management (CM), peer group therapy, and intensive case management. We 
conducted meta-analyses of comparative studies and evaluated the strength of evidence (SoE). 
The PROSPERO protocol registration number is CRD42018115388. 


Results. The literature search yielded 33,272 citations, of which 118 studies were included. 
Motivational interviewing reduced heavy alcohol use days by 0.7 days/month, alcohol use days 
by 1.2 days/month, and overall substance use problems by a standardized mean difference of 0.5, 
compared with treatment as usual. Brief MI did not reduce cannabis use days (net mean 
difference of 0). Across multiple intensive interventions, Fam was most effective, reducing 
alcohol use days by 3.5 days/month compared with treatment as usual. No intensive 
interventions reduced cannabis use days. Pharmacologic treatment of opioid use disorder led to a 
more than 4 times greater likelihood of abstinence with extended courses (2 to 3 months) of 
buprenorphine compared to short courses (14 to 28 days). 


Conclusions. Brief interventions: MI reduces heavy alcohol use (low SoE), alcohol use days 
(moderate SoE), and substance use-related problems (low SoE) but does not reduce cannabis use 
days (moderate SoE). Nonbrief interventions: Fam may be most effective in reducing alcohol use 
(low SoE). More research is needed to identify other effective intensive behavioral interventions 
for alcohol use disorder. Intensive interventions did not appear to decrease cannabis use (low 
SoE). Some interventions (CBT, CBT+MI, and CBT+MI+CM) were associated with increased 
cannabis use (low SoE). Both MI and CBT reduce combined alcohol and other drug use (low 
SoE). Combined CBT+MI reduces illicit drug use (low SoE). Subgroup analyses of interest 
(male vs. female, racial and ethnic minorities, socioeconomic status, and family characteristics) 
were sparse, precluding conclusions regarding differential effects. Pharmacological 
interventions: longer courses of buprenorphine (2—3 months) are more effective than shorter 
courses (14—28 days) to reduce opioid use and achieve abstinence (low SoE). SRs in the college 
settings support use of brief interventions for students with any use, heavy or problematic use. 
More research is needed to identify the most effective combinations of behavioral and 
pharmacologic treatments for opioid, alcohol, and cannabis use disorders. 


vil 


Contents 


FLV ON CO: SUMMA DY sc ssesssccadscSenascauaiedasstsvedsesesuice seousuonsuoensedossavsassnouascconvespunescondecsousspniessnieuacstenpacsves® 1 
PUTO WOON io cinsssesoksaewedecsinns cossueovieseandsnaesssuusctbtas spanvennéesninns counbaevbuebiauscesossnedespuacenspubenvecesnndedcouseees 1 
Back or ound ANd: CBC C tI VES as ccc ces oases edad conc nsanbanacancceuteu ented atinrncebadeeedastangssn doen statanedemwaiebaiads 1 
Cy OUCE TONS atta dats and tenst ah ane tata sald taal Sails Sa ela Ne Sad Sah ae te a duuee AS 2 
IWRC CH OS vcssses ixectsins cansenietaceussuesctnteesnsenes apuatoabelacuueiashebetileiecsnabenscbnaustaseiebaptebesins cobnet antnensbsbusteavareeiatbess 4 
Dearchine TOF ThE F Vide Ces<).2 css hedushandlaseaeidcas pieoade boaeiedasdaealeatenenscasbikeaneiasauagdaediaabancaasianiales 4 
Sidy, Bai liby awstats tat acanie ra aaeiees aatneanteem Geena ean eens es 4 
J22 8) C10) 218101) eee ee Senne errr a SERRE RRS Oe ee fone Snr ee Se ePIC See ren ONT Se aRE NT eo CE Mee Ae rit Aen te 4 
Interventions: and CO par AtOTs sc} eds sa ocnesessei cin asceeroded neds kas ame ete cae rinnctuate anna eeeeee: 2) 
OUUC OMICS 52. ce eon est eae a eed eh ates a ea od Aaa bE a as ede ode a laa a 
SIS FT ores 8s Racecar Neg lndidlc cernceeos tetous oc vxctsnerssn de or ose deeaso os bs eat ns oot ott cd ousadeasys olan uneasy uae ehcuas 6 
Screening Studies for Blob ny issu. tertiles ein eee ae eK! 9 
Data EX traction ci. shctss bast alseneeteratccssaavintedavaccay an entenecse anaes abt eaters ibe edd lahscae es 9 
ALENT CG COIN acess foticte sia oaincd eyed m caunian data eastooectuiaclak Sicrepan dius eae rtnsad Meal a oie 10 
MSCMETAL PITT CUS IES 5 eh 2025 oo oscar cs 202, tue cu asa suuattedeagaess satay uduaes oacsaea teeta iouv ceasev head aesteassnonanay tens 10 
Motivational Interviewane (ML) 25 esac. Sececcs sgh sexcuseederanssacedsteeuseces tied egaysuedersedses castonuieens trace 11 
Family: Pherap VCH ain) 2 asi. ccsb%ctocash ast eviswardeahdstau naadrodocasbandaetraugedeadlstds tastes uesbatbeeraanibagsskneas 11 
Cognitive Behavioral Therapy (CBI) sicsds.cccssccrste iessdncteabteterdessetisatedenteentecauckinieaudesduiaventecss 11 
Peer Group herapy (Peer Group): cacssacanss oeccversecrccsenaceeuagayannaudedevacunsvaieswadensncassqeanganeteatieas 12 
MS VCMOcdicar On AUC iach chor sities seyactiesvateisnneupticcviees stay nal usa taseccase ete ceauatgnetloaes iets 12 
Contingency Management (CM): sii cccsccssanlaveaisa cceeanevastasiag Atateoastadas (daadavie tes csecxdeesaaaa 12 
Intensive Case Management (ICM ) ss.24:205icesbsndsneaaeedacsbantazassuaed cap stand esaevieedbandeeaounsdac taadveas 12 
‘Lreatment as Ustal CLA ex. jo5 sss sesauhiicssy exe Oa A 13 
ATLET VST TE WOT HIEIS scars us cect seaeic a sied aucctars mate oeguszvads waaneecagieanessuueeaee eiianact wade Monaenueememeean ae 13 
ASSESSTENE- OL RISK OF Bias iss skass oisats crac oeasostdvevscdbisrcsnn cMinevbedssscobahliies deaicrdhdde ten cstnaseymebtona ets 13 
Data S VOWS 1S secics Secakcaissea es darned ta sedan tates lasense cetancoes apc nig Sav Sahin comme tose nea ee 14 
Qualitative Evid Efe’ Sythe sts ce (casinc.isy ouccanscadacts al sansnsssecio'soduanasvageudsa deuce voinasMavaseaasta sucess 15 
Quantitative Evidence S Vnthesiseccisveics occ desdanseitiecadewilaaacanch wae huianatniss 15 
Grading the Strength of Evidence for Major Comparisons and Outcomes ...........:ceeeeeeeeeeeeeee 17 
PRSSESS HNO ADI MCAT ICY 2c cakins slagecns una int wie eaesediesaieansucea tee see teeta as audeas veraas dunes vaca ine ata anearhastaseanitey 18 
BROS ULES easecs cused thus eseenedeat becuse taseuc eben tis rats ba ste abs oa aes eae leat aeoia bts hasten caeueeedlW cutee dea saclans n ntaeats 19 
RJUVAT TALIS CALC OO LIZ A tL OTN ea ces ecenracie Pines essa Se cece ad deooea i acins iach res acu Duce de ealea We oarecp Nata te wy Bectndys Chowne 19 
Brief Behavioral Tnterventrois oi cesxs5easder scastaes' tangs seceadae ataaenices deans a idasia caps iaaseediaadlead 20 
Nonbrief. Behavioral Interventions... 5 ..as35i5.0)csdeavidesteceeasjosea seas actiahavin iniaceandewustbviucds atone 20 
ISTIEL, Behavioral Witery CMtiOns coca sect atessmassaatesdanceacaceraeneee tus seeanbbavatine ceangesuaea tet atan auastasuaseanceas 21 
Cy POMS caste tan tetelntshant ateataca st yaacSeli elena Clash ea kta da cctuls taltany teed teat tal nado tod sauce 21 
Studies Not Included in Meta-Analyses...........:cccccccsscssssessseceeceseceeceeeseecaeceecseeeeeseecsaeceeesees 21 
BRISK: OP BIAS cxstssascteiavidics icesnna tea stedtidaxgiaa evi Mau amen eens alane eas ead 2 
Nonbrief Behavioral Interventions cis. cteiuiscdaeraintinenay aie neal einnattaaeaalon 36 
MSY PST ES sacar chs ete cre aac aaeas vote te ana ceca ouleeaa reueae naw ede dudateas because adage aan tenbadenmnmaeonteas 36 
Studies Including Arms With Nondistinguished Intervention Codes ...........:.e:cescceseeteeeeeees 36 
Substances Other Than Alcohol or Cannabis .0..........cccccecccessceseeeeseeeeeeeseceeeeeeeeesseeesaeenseeeaes Ey) 
ISIE Ol EATS 2a caas MS ertecsts ode atater ys nctnceag eerocuecvs de les dat oe cea va Bonde as vsstsceee eas ovat oecate ow dsteae as Tostasino atet 38 
Network Meta- Analyses 22 csitieeineatinvioxdh uaiee eee ine een 38 
Systematic Reviews of Treatments for Alcohol Use in the College Setting «0.0.0... eee 54 


vill 


Rey POIs cchascceal accel tae eae aaa ese au ban tess 54 


General Population of College Students Who Drink AlcOhO] 0... ceeeeteeseeereeeeeeteeeseeeeees op) 
College Students Mandated To Receive Interventions for Alcohol Use ..........ceeeeeseeereees 56 
College Students Who Engaged in Heavy or Hazardous Levels of Alcohol Use................. 56 
BRISK OP BAAS cc) sts cyarazvaes adi lina elas sestua aecuncten-abas ued nu aa do easasiza nese saab anscaeea eee pad ea a7 
Pharmaceutical Inter y Cntions sisigsisiscyes seca saahaves caaveatasnetucdvaasdonvanves vedeensean sais teGaesnsennagubeecceansaive 59 
SY PIES ages 2o5¢ Succ auueswlaceasttior tes ota sunas ages auton a ra caaee onto tauamarabaoustenarangacrauntertuencasmanastanae 59 
COprond USE PiSO rer 2 snoute canes ia bu daatatini an sues ted tenet nahh wiacatuuns enya te atesg ten ewlaet saci ta 59 
Alcohol Use Dis Ord er es.sa ca scassisesietseiec daw nes Si suiy osaaslicoie tad clas Oaaitenee lee ors odaaptaetatadeds alate lasccsins 64 
CAPT IS SS: aaicdits za saesSs and ava sw sutueee into tac yaaayaoea aude nadeaalaswsdslcuachaeediee daabasetote aaa aaaate aeRO 67 
Comorbid Psychiatric Disorders in Adolescents With SUD .........ceccceccseceseceseeeeeeeeeeeseeeteenees 68 
Sys ITE shes tgs, cccsete a gureeta avec cise whe awe esa cum tineeas wane tan eaame renee anaganeiunt tuna atanaecamantantess 68 
Specitic Psychigtic COmOl DIGMIeS iis.a is asec ayisede ease spncdses tats acieal Tcia eave iapactoc skal neha 68 
DVISCUIS SLO sehen Scene cosstes sanaceusiucecnte ososessbussdbesseulsceusisnpnnsetvesuc snasastesesecvecteavaswei pene baenceuscsenobensctnavarnsépeet 75 
My PAINTS oF erccen Via eg av castes totcdets actasge see ress Vasied iss gomde ts eamucwonias tein audios Matar een basen 75 
Findings in Relationship to What Is Already Known .........ceeeesceeseesseeseeeeeeeeceseceseeaeeeeeeseeeaeenaes 80 
Brief Behavioral Interventions: .i.cc.c.sccsiasecduciesteeseigocadecghsniecoustvadectrsnsesnauiadeccusndamveadentevinastecn 80 
Nonbrief Behavioral Interventions 5. sicsisi diets savas asoakaianeasedhare sme eandia teams nemataere eta 80 
Phar acolooie, Interventions sh 255 vc secst el sea suns, Steed ot ee tata adens tu onguadtacaients devon auuhemasineins 81 
Pharmacologic Treatment of Psychiatric Comorbidities in Adolescents With Substance Use 
DUS OR SES 5 ecscios ass aeaizsracvsrsds nasicnna'e gw tas ands dasraneduadatibu he deraesdoca aad Geass wuatanataaaumess ees aaa Goaatadhaonnes 81 
PPP CADIUUY sec ccscvzeicvicassaiasnus coeedadeheveeak iviea dens walbaegemsag ance ag ed eae anetane nee 81 
Implications for Clinical and Policy Decision Making ...........ccccecceeceeeceeseeeeseceeeeeeeeeeeeesaeens 83 
Limitations of the:Systematic Review Process oiias, vais suaneen otuays vq tesd nays sma wieeas dversamsenodeniiaeraned 83 
Limitations. of the EvidenGe Base i. c.d.daisersessesaae dissncvisdes eoascia dee veend atures tuanne aati teatens 83 
Recommendations for Future Research: s:ccvicustesdscarsassucdbanduasasnucdivatsbresachansbenstandedionseeouasdarianes 84 
CONG US TOTS se ci cg ans ieee see aa Oat aa ca li lati Taras NAN a er aac eas nha aN, 85 
IRGLCROMICES Sesseictisecesssescathdopiscucosavensdsduenasnseessuss epiadsssuatsaudesuvaceebensaavescensuncebuslenebsaueayssdeassauscunsnderoaties 86 
ADDeVIAHONS ANG “A CFONYIMS s.ssccicasesasssssesnssessssessscsssusssesoocsencdssuescdbssassecssoussesdsbevesctesussesboaeeedce 108 
Tables 
Table WV. FGIDMMY CHLCT A co oy wcaviraisee svar, Sausas las vetaadenaeeesic epee Rees eu tana aes andes ta 6 


Table 2. Results: Brief behavioral interventions for substances other than alcohol or cannabis.. 22 
Table 3. Brief behavioral intervention studies with two treatment arms with nondistinguishable 


COIN OM SINS 2 ecco ca vs ceca gohbda Seo weivs tan Sava eave caste ata nb Vag age Ma ded kag lic ca AE Baa Sanda Sad OR 23 
Table 4. Brief behavioral intervention studies with three treatment arms with two 
nondistinguishable components that were pooled In MA... ceeceecceesseceteceteceeeeeeseecesecnteeeseeenaees 23 
Table 5. Brief behavioral interventions and alcohol abstinence: Net mean difference of days per 
month of abstinence between all interventions .i.02.0.06s.05.deesedess saad vsedkssdssakcesraasaededeessdaseesdsedencvaase 27 
Table 6. Brief behavioral interventions and alcohol abstinence: Odds ratios for abstinence 
STAY SE Be AME BTSTVSTUEN ONS aus. 5ie chose Sesesies vs tarantino oaiek sa ade Ne Ade dete Soebaic va Sete h semi a dons bane eae 29 
Table 7. Brief behavioral interventions and cannabis abstinence: Odds ratios for abstinence 
Between all MtEny Sr ONS 355065, she cbeatuis Sact5 \etatadandadas Vass tussay dace akduen Soa utd Weve ss uta lacs akdinkatastelukdains 32 
Table 8. Legal outcomes with brief behavioral interventions.............ccceeeeeceeeeceteeeeeeteeeeeeereeeenaes 33 
Table 9. Nonbrief behavioral intervention studies with two treatment arms with 
nondistineuishable components oss secede eke acsewered aa een tadess Mea taw Sash eaeetedus Gace cates 37 


ix 


Table 10. Nonbrief behavioral intervention studies with multiple treatment arms with 


Hondishineimshable CompPONEIIS 12.2 yicnak2seveer secaseddac ours nade Toacsdedicwsabaeduaespttvarceanstltadeniid wendooaieas our 
Table 11. Results: Nonbrief behavioral interventions for substances other than alcohol or 
WATMTRADD ES «3 fasts &caceest td oy Soectgn sucess Ge ne odes Goslaee bag aside casio eae Soe RE has EN ee IES 38 
Table 12. Nonbrief behavioral interventions and alcohol use days: Net mean difference of use 
days per month between all interVentions............c.ccccecsseceseceseceseceescecaeceseceeeeeeseecsaeceseeeeeeeneeesaeees 41 
Table 13. Probabilities of nonbrief behavioral interventions ranking in top third, middle third and 
bottom: third to reduce alcohol Use dave. estes cas ueisoe Miudla ss craaste wien sree eee veas cent waaaes 42 
Table 14. Nonbrief behavioral interventions and cannabis use days: Net mean difference of use 
days per month between all interVentions............cecccecsseceseceseceseceeseecaeceseceeaeeeseecsaeceseceeeeeeseeesaeees 45 
Table 15. Probabilities of nonbrief behavioral interventions ranking in top third, middle third and 
bottom third to reduce cannabis use dayS ..........:cccsccessceesceesseceeceeeeeseeeeseecaecneeeseaeeeseecuecnseeeeaeensaes 47 
Table 16. Nonbrief behavioral interventions and aggregate alcohol and other drug use: Net mean 
difference of use days per month between all interventions 00.0.0... ccc ceeceeseeeseeceteceteeeeeeeeseeeaeens 50 
Table 17. Probabilities of nonbrief behavioral interventions ranking in top third, middle third and 
bottom third to reduce aggregate alcohol and other drug use dayS...........ccceeceesceesceeeteceeeeeeeeeesees 51 
Table 18. Nonbrief behavioral interventions and illicit drug use: Net mean difference of use days 
per month between all 1NGerventlOns se. 334.95 cessed ues caei deed Me ce epsccu ean eat teed aeedee weed ee 
Table 19. Probabilities of nonbrief behavioral interventions ranking in top third, middle third and 
bottom third to reduce illicit drug use days 0.0... cee eececseesseceseceseeeeseeeseecaeceseeeeeeeeseecaeeneeteeeensees a3 
Table 20. Other outcome participant SumMaries 5 :. 024.23 .i22ssccstaccasasoinssdidaisstacdhovieastaadasdaraassacddasdases 54 
Table 21. Risk of bias in college alcohol intervention systematic reVieWS ..........ceseeseeceeeeeeeeeeee 58 
Table 22. Baseline data and Interventions: Pharmacologic interventions for opioid use............. 59 
Table 23. Results: Pharmacologic interventions for opioid use disorder .............ceceeseeseeeeeeeeeees 62 
Table 24. Baseline data and interventions: Pharmacologic treatments of alcohol use................. 64 
Table 25. Results: Pharmacologic treatments for alcohol USC ........... ce eeceeseeeeeeeceeenseeneeeseeeeeeseenaee 66 
Table 26. Baseline data and interventions: Pharmacologic treatments for cannabis................... 67 
Table 27. Results: Pharmacologic treatments for cannabis USC ...........ceeseeeeeeceteceeeeeeeseeeeeeseenaee 68 
Table 28. Baseline data and interventions: Pharmacologic interventions for psychiatric 
comorbidities in adolescents with substance use disorder ...........:ceceseeeseeeeeesecesecneeeeeeeeeeeeeseenaes 69 
Table 29. Results: Pharmacologic interventions for ADHD in adolescents with substance use 
GISOLICTS ayer niate ny caine ea Reig nasa oe eR ee ae a I ee 71 
Table 30. Results: Pharmacologic interventions for depression in adolescents with substance use 
CTS OTASIS sic, ts iseiceds ness ests dss a eeaus wend cavteaso resensnd dele ets emealea aay naan eddies ans lead a acatstemandiaelea 1 
Table 31. Results: Pharmacologic interventions for bipolar disorder in adolescents with 

SUIDS ALICE USE CISOECEES exegesis re cece sceciess costars 1s Satin soa to cea uated co sen oa tease Slav a eens oeotaeonctaeseees 74 
Table 32. Evidence profile for interventions for substance use disorders and problematic use in 
AMOLES CONES: 5 c525sdccdies secs igh saan geauegsaeipnedacaasaecnsa sudovaseshs loans pug fuceesbsqsceas iad w Mantes uaa duane abeeea eeataseeaine 77 
Table 33. Number of meta-analyzed studies reporting outcomes for alcohol only, cannabis only, 
EU ae Nae ia cg Ec ae ce Sc as cad Sasa eat onl phate a 82 
Figures 

Figure 1. Analytic framework for the Key Questions...........cccccccccessceeseeeseeeeeceseceeeeeeeeeeeeenaeeneenaes 3 
Hipure 2p eiteratire TOW Ia OTANI C0 chess snsoauccs eed euhehun Bact vad dacmucataneneRieeareegsugiecscaslerseneasnean mentees 19 
Figure 3. Meta-analyzed brief behavioral intervention studies: Percentage of studies in each risk 
OE DIAS. CALCD ORY fc sadica ccscns ies nasa ova Secwga Alea oxdassetota an iap Cea SAI tated aia seas ants aan hla Maa 24 


Figure 4. Evidence graph for brief behavioral intervention studies reporting heavy alcohol use 


AY S acct ca diaivsa eaicntnatied Nich acy tes Sale Mary Ia ec Soci yale dda leaghandsu yaa aR i cnna tadasacnalesdlgcscind spesueae linet dachhatiinbandentenead 2 
Figure 5. Heavy alcohol use: Forest plot depicting individual study effects with summary 
estimates of the relative effect of MI versus TAU.........cccccscccssccessecsseceseceeeeeeseecaeceseeseeeeeaeecsaeees 25 


Figure 6. Evidence graph for brief behavioral intervention studies reporting alcohol use days .. 26 
Figure 7. Alcohol use days: forest plot depicting individual study effects with summary estimates 


of the relative eficetot MI versus TAU iui ressscai lan tonstuatescisttes sau uanseeubacsuttlonpeuudavdn Basnamtaardaties 27 
Figure 8. Evidence graph for studies reporting alcohol abstinence ............ceceeseeseeceeeeeeeeeeeeeeeees 28 
Figure 9. Alcohol abstinence: MI (brief intervention) versus TAU ..........ccesesseeseeereeeeceteeneeeneeees 28 
Figure 10. Evidence graph for brief behavioral intervention studies reporting cannabis use 

CLAY Sessa eee aaa acai Has Tagen nee valuta ecaaoua Saat neaesens led ical won Sama ser er nia oa tabug evans 29 
Figure 11. Cannabis use days: Forest plot of net mean difference for MI (brief intervention) 

RESTS UTS PU ae bs esetit aga cll anle wlnsand ein alharatocan cea tacta lind assed shla tig atone ae Salssoa as Nooad uns asp qeag uutued 30 
Figure 12. Cannabis use days: Forest plot of net mean difference for the brief interventions MI 
VSTSUS UG she rie sated acted dstowe ees csot os lnc a aed ysf rs uate Sega dos od a Oe aap Ae eden Dade Bate oemencea eens 31 
Figure 13. Evidence graph for brief behavioral intervention studies reporting cannabis 

ADSTINEN CC visa lnge torch va lesckstuodussaady atdoea lots iebtei@eetsaaekd huts obavialectsaktescuutedia eurtv bls asunder ea Mien 31 
Figure 14. Cannabis abstinence: Forest plot of log odds ratio for MI (brief intervention) 

COMP aren! Wyath K Ailes. Set scat ceetiledoa ds yecwaraseadisanshccaseendecn ins sh pore aaehedes acta ainscnannear ee uae a2 
Figure 15. Evidence graph of brief behavioral intervention studies reporting a substance use 

PROD lea SCAN Es uis0cc5 cetietanaestucsbetost cree ladaotactaeiased each bit tersaeed dy bvtns aha zandeaattens deraas yea banicagdetasemaaeld 33 
Figure 16. Substance use problem scales: Forest plot of standardized net mean difference of the 
bret interventions Mil versus AU a cstes.csai.5 cc say a catisnsssuiede ha ahgatanal hadi snagenaddenetin am aeAeeier. 34 
Figure 17. Substance use problem scales: Forest plot of standardized net mean difference of the 
briefantéerventions MI versus Bque -iccctesccsesadisots ta sire levsledesedicend innstieratnnincdsSvacedeveautaiwaaieeeatadnontes 35 
Figure 18. Meta-analyzed nonbrief behavioral intervention studies: Percentage of studies in each 
TISK-OF DIAS CALC OOTY soot eects eaten sco easter iccan eahesiey ie caus catia eacea maa tvreaeiuneaae ees 38 
Figure 19. Evidence graph for nonbrief behavioral intervention studies reporting mean alcohol 
MISC LAYS, Ses risk gece base ams ec cledan oa cass ws pale atta a miorsa beds aetue Rie panda eaictecmtan foaw nak aiaedeltd casaeaensieat sued 39 
Figure 20. Alcohol use days: Summary forest plot of meta-analyzed net mean difference for all 
interventions studied compared with TAU .0......ccecceccccceseceseceeeceeseeceseceeeeeeeeeseecsaecnseeeeeeeneeesaeens 40 
Figure 21. Evidence graph for studies reporting cannabis use days ...........ceseeeeseeeeeeeeeeeeeneeeeeees 43 
Figure 22. Cannabis use days: Summary forest plot of meta-analyzed net mean differences for all 
interventions compared With AU), eccsie oate vince decndhausepdeed oie tavass swapulstiande dis riadeddalaoadia mapedoawaas 44 
Figure 23. Evidence graph for studies reporting aggregate alcohol and other drug use days ...... 48 
Figure 24. Aggregate alcohol and other drug use: Summary forest plot of meta-analyzed net 
mean differences for all interventions compared with TAU .......ceeceececeseceseceeeceeseeceseeeteeeeeeensees 49 
Figure 25. Evidence graph for studies reporting illicit drug use days ........eeeecceesseeeteceteeeeeeeenees 51 
Figure 26. Illicit drug use days: Summary forest plot of interventions reporting meta-analyzed 
TIGIt Crus USE Gays Compare to AN se coasts cotee a3 oh os ie rede eaten co a Coa ok east aaieuel ta 52 
Figure 27. Pharmacologic intervention studies for opioid use: Percentage of studies in each risk 
GE DIAS CALC SONY 5 sissies ifawiSeashak tapas ceadatn sadeavued tas eteayensdasiadaadanglncbsaeedinsa dasseadgatedcaadaee eianewiasdaasases 60 
Figure 28. Pharmacologic Interventions for alcohol use: Percentage of studies in each risk of bias 
CASSIS cet secact elas eaiec chica oats nena wna teed vig a aoe saeaseaeias erate gn cee gu atone Seamed nah aaa memes ENS ras 65 
Figure 29. Pharmacologic interventions for cannabis use disorder: Percentage of studies in each 
TISKOF DIAS CALS COTY ase x lectus tele watesoa ase saw esta nt Asada ta von Sa Re nA ded an Nad eo Ss 67 


Xi 


Figure 30. Pharmacologic interventions for psychiatric comorbidities in adolescents with 


substance use disorders: Percentage of studies in each risk of bias category ..........cceeeeeees 


Appendixes 

Appendix A. Search Strategies 

Appendix B. Excluded Studies 

Appendix C. Intervention Coding Manual 

Appendix D. Baselines 

Appendix E. Outcomes Extracted by Study 

Appendix F. Brief Interventions: Detailed Results 
Appendix G. Nonbrief Interventions: Detailed Results 
Appendix H. Risk of Bias Assessments 

Appendix I. Technical Appendix 


Xil 


Evidence Summary 


Main Points 


Adolescents, 12 to 20 years of age, with problematic alcohol and/or cannabis use or use 
disorder 
co Brief behavioral interventions (that involve 1 or 2 encounters only) 


Motivational interviewing decreases days of heavy alcohol use and overall 
alcohol use. 

Motivational interviewing has not been found to decrease cannabis use. Further 
research is needed to identify if any other brief interventions may decrease 
cannabis use. 

Motivational interviewing decreases problems associated with substance use. 


o Intensive behavioral interventions (that involve more than 2 encounters) 


Family-focused therapies reduce alcohol use. 

None of the interventions have been found to decrease cannabis use. 
Motivational interviewing decreases combined alcohol and other drug use. 
Combined cognitive behavioral therapy and motivational interviewing decrease 
illicit drug use. 


Adolescents, 12 to 25 years of age, with substance use disorders 
o Pharmacological interventions 


In opioid use disorder, longer courses (2—3 months) of 
buprenorphine/buprenorphine-naloxone are more effective than shorter courses 
(14-28 days) to reduce days of opioid use and achieve abstinence. 

More research is needed to understand the role of medications in treatment of 
alcohol and cannabis use disorders and of pharmacological treatments typically 
used for comorbid psychiatric illnesses. 


College students with problematic alcohol use 
o Behavioral interventions 


Mandated alcohol programs decrease alcohol use in the medium term, regardless 
of intervention. Four commercially available interventions are more effective in 
the short term than no intervention. 

Brief behavioral interventions, particularly those based on motivational 
interviewing, reduce alcohol use compared to no intervention in college students 
with heavy or hazardous alcohol use. 


Background and Purpose 


In 2017, an estimated 992,000 adolescents aged 12 to 17 in the United States (4% of the 
adolescent population) and 5.1 million young adults aged 18 to 25 (14.8% of the young adult 
population) met diagnostic criteria for a substance use disorder. When left untreated or 
ineffectively treated, adolescents with substance use disorders are at risk of experiencing a 
cascade of far-reaching adverse outcomes that often persist into adulthood. The pervasive 
negative consequences associated with untreated or ineffectively treated adolescent substance 
use, and the high lethality of opioid misuse, underscore the importance of identifying effective 
interventions to treat adolescent substance users. 
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The review aims to inform health care providers, policymakers, and a clinical practice 
guideline update from the American Academy of Child and Adolescent Psychiatry (AACAP) 
about the currently available evidence on interventions for adolescents to reduce or cease 
substance use. The review addresses both behavioral and pharmacological interventions used for 
adolescents or young adults with problematic substance use or a diagnosis of a substance use 
disorder (SUD), excluding tobacco. 


Methods 


We employed methods consistent with those outlined in the AHRQ EPC Program Methods 
Guidance (https://effectivehealthcare.ahrg.gov/products/cer-methods-guide/overview). We 
describe these in the full report. Our searches covered reports published from database inception 
to April 11, 2019. Behavioral interventions were described based on their inclusion of seven 
primary intervention components: motivational interviewing, family-focused therapy, cognitive 
behavioral therapy, psychoeducation, contingency management, peer group therapy, and 
intensive case management. Pharmacologic interventions were divided into those used primarily 
for problematic substance use (or use disorder) or primarily to manage psychiatric comorbidities. 
The PROSPERO registration number is CRD42018115388. 


Results 


We found 118 randomized controlled trials that evaluated treatment of adolescents or young 
adults with problematic substance use or substance use disorders. Most studies enrolled 
adolescents with some combination of alcohol and cannabis use. The most commonly reported 
outcomes included frequency of use and abstinence. We describe evidence about five major 
categories of interventions: (1) brief behavioral interventions (consisting of one or two 
encounters), typically targeted at adolescents with problematic use; (2) intensive (nonbrief) 
behavioral interventions; (3) pharmacological treatments for psychiatric comorbidities in 
adolescents with concurrent substance use disorder; (4) pharmacological treatments used to treat 
use disorders; and (5) interventions of any kind for alcohol use in the college setting. 

Our meta-analyses of brief interventions found that motivational interviewing reduced heavy 
alcohol use days by up to 0.7 days per month, alcohol use days by up to 1.2 days per month and 
overall substance use problems by a standardized mean difference of 0.5, compared to treatment 
as usual. However, brief motivational interviewing did not reduce cannabis use days (net mean 
difference of 0). 

Of the multiple intensive interventions, family-focused therapies were most effective; they 
reduced alcohol use days by 3.5 days per month compared to treatment as usual. None of the 
intensive interventions were found to reduce cannabis use days. 

For the subgroups of interest (male versus female, racial and ethnic minorities, 
socioeconomic status, and family characteristics), data within or between studies of brief and 
intensive interventions were sparse or not available. Therefore, no conclusions regarding 
differential effects in these subgroups is possible. 

Pharmacologic treatment of opioid use disorder led to a more than 4 times greater likelihood 
of abstinence with an extended (2 to 3 month) course of buprenorphine compared to short 
courses (14 to 28 days). Similarly, a slow buprenorphine taper (over 56 days) was more effective 
than a 28-day taper. 

A review of existing systematic reviews found that treatment of problematic alcohol use 
among college student with behavioral interventions resulted in small improvements in alcohol 
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use. In students with heavy or hazardous use, single-session interventions resulted in a small 
reduction in alcohol consumption. In students mandated to treatment, there were small 
improvements in heavy drinking frequency and alcohol-related problems in the medium term. 


Limitations 


For many topics, evidence was sparse or entirely absent. Most studies enrolled some 
combination of adolescents with mixed use of alcohol, cannabis, and occasionally other drugs. 
Very few studies evaluated users of opioids, methamphetamines, or substances other than 
alcohol or cannabis. Studies often combined different types of interventions, making 
comparisons of specific interventions difficult. The available studies did not consistently report a 
common set of outcomes, which limited our ability to combine information from potentially 
relevant studies. For most outcomes, individual studies were deemed to have moderate risk of 
bias, most commonly due to incomplete outcome data, poor compliance, and a lack of blinding 
of participants, study personnel, and outcome assessors. 

The existing systematic reviews addressing treatments for alcohol use in the college setting 
were inadequate in their assessment and reporting of risk of bias and did not discuss the 
consistency of results. 


Implications and Conclusions 


Compared with treatment as usual (e.g., brief advice and a handout), brief motivational 
interviewing for adolescents with problematic substance use reduces both heavy alcohol use and 
overall days of use and may decrease problems related to substance use, such as missing school 
or work or getting into trouble. Among intensive interventions, family therapy (with a focus on 
intervening in the entire family system) was the most effective in reducing alcohol use. 

Neither brief motivational interviewing nor intensive interventions have been demonstrated 
to reduce cannabis use. For opioid use disorder, buprenorphine and buprenorphine-naloxone are 
more effective for the short-term management of opioid withdrawal if they are tapered over 
longer periods of time. 

Further research is needed to identify: (1) effective brief and intensive interventions for 
problematic cannabis use and cannabis use disorder and (2) effective combinations of behavioral 
treatments and medication to treat alcohol and cannabis use disorder(s). In addition, (3) studies 
of longer term pharmacological treatment of opioid use disorder are needed in this population. 
Future studies should evaluate outcomes that are most meaningful to adolescents, such as better 
functioning in school and improved relationships with peers and parents. 
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Introduction 


Background and Objectives 


In 2017, in the United States, an estimated 992,000 adolescents aged 12 to 17 (4% of the 
adolescent population) and 5.1 million young adults aged 18 to 25 (14.8% of the young adult 
population) met diagnostic criteria for a substance use disorder (SUD).! Thus, about 1 in 25 
adolescents and | in 7 young adults had a diagnosable SUD. The vast majority were untreated, 
with fewer than | in 10 adolescents or young adults with a diagnosable condition receiving 
specialty care.! When left untreated or ineffectively treated, adolescents with problematic 
substance use are at risk of experiencing a cascade of far-reaching adverse outcomes that often 
persist into adulthood, including sexually transmitted infections,” unintended pregnancy,° 
criminal involvement,’ school truancy,° psychiatric disorders,° and physical health problems.’ 
Adolescent substance use is also associated with the leading causes of death in this age cohort: 
suicide, unintentional injury, and violence.* ? 

Alcohol, marijuana, and tobacco are the most commonly misused substances, followed by 
prescription and over-the-counter medications, among twelfth graders;'? with 1 percent of youth 
between the ages of 12 and 17 reporting current opioid misuse.'’ Youth who use opioids are 
more likely to use other substances.'° Among youth under 21 who initiate heroin use, 80 percent 
misused prescription and/or over-the-counter medication before the age of 18.!? National 
concerns about opioid misuse, encompassing nonmedical use of prescription opioid-based 
medications (e.g., morphine, fentanyl) and the use of illegal opiates (e.g., heroin), have brought 
heightened attention to the significant risk of drug overdose death in adolescents.!° 

The pervasive negative consequences associated with untreated or ineffectively treated 
adolescent substance use (SU), and the high lethality of opioid misuse in particular, underscore 
the importance of identifying effective interventions for substance use in adolescents. 

In 2005, the American Academy of Child and Adolescent Psychiatry (AACAP) created a 
Practice Parameter (PP) for the Assessment and Treatment of Children and Adolescents with 
substance use disorders. The 2005 Practice Parameters made eight recommendations pertaining 
to treatment. For behavioral treatments, AACAP concluded that family therapy models “have the 
most supporting evidence” and “individual approaches such as cognitive-behavioral therapy, 
both alone and with motivational enhancement therapy, have been shown to be efficacious.” 
AACAP recommended that “medication can be used when indicated,” noting that this 
recommendation was “not based on empirical research in adolescents but rather on research and 
experience with adults.”!* The AACAP also recommended that psychiatrists consider co- 
occurring mental health disorders, since the majority of adolescents with substance use problems 
present with a co-occurring mental health diagnosis. Recommendations made in the 2005 PP 
were limited by a relative lack of rigorous trials at the time. 

Since the publication of the 2005 PP, there has been a proliferation of adolescent substance 
use treatment trials, many of which have employed more rigorous designs, larger samples, 
random assignment, direct comparisons of two or more active treatments, improved measures of 
substance use and other variables, newer interventions (e.g., manual-guided interventions), and 
longer-term outcome assessments. This systematic review (SR) will inform a Clinical Update 
and Clinical Practice Guideline to update the 2005 AACAP PP for the Assessment and 
Treatment of Children and Adolescents with SUDs. Given the high co-occurrence of substance 
use and other mental illnesses, and the increased focus on integrated treatment, there is a great \ 


need to evaluate the evidence, and to engage researchers and clinicians, including primary care 
physicians, regarding the most effect treatments for substance use in adolescents.!° 

In 2014, a guide developed by the National Institute of Drug Abuse (NIDA) identified 
multiple approaches to treating adolescent SUDs, which were divided into behavioral 
approaches, family-based approaches, addiction medicine, and recovery support services, but this 
report did not synthesize evidence on comparative effectiveness.!° The American Academy of 
Pediatrics (AAP) Committee on Substance Use and Prevention recently recommended 
consideration of pharmacotherapy for adolescent and young adult patients with severe opioid use 
disorders or co-occurring alcohol use disorders.'” Thus, there is a significant need for a rigorous 
and comprehensive synthesis of the adolescent substance use treatment literature that addresses 
both pharmacologic and psychological treatments. 

The overarching goal of this review is to evaluate the available evidence for the treatment 
effects (and comparative effects) of available behavioral and pharmacologic interventions to 
manage SUD and problematic use (not including tobacco) in adolescents and young adults. The 
review evaluates treatment effects across population subgroups and identifies evidence (or gaps 
in evidence) regarding the key ingredients of successful interventions for problematic substance 
use in adolescents and young adults. For most specific topics, we conducted de novo systematic 
review, but for treatment of alcohol use disorders/problematic alcohol use in the college setting, 
we summarized existing SRs, since this literature is large, highly contextual, and has been 
extensively reviewed. 


Key Questions 


Key Question 1. What are the effects of behavioral, pharmacologic, and 
combined interventions compared with placebo or no active treatment for 
substance use disorders and problematic substance use in adolescents to 
achieve abstinence, reduce quantity and frequency of use, improve 
functional outcomes, and reduce substance-related harms? 


a. How do benefits and adverse outcomes of interventions vary by 
subpopulations? 


b. How do benefits and adverse outcomes of interventions vary by 
intervention characteristics 


Key Question 2. What are the comparative effects of active interventions 
for substance use disorders and problematic substance use in adolescents 
to achieve abstinence, reduce quantity and frequency of use, improve 
functional outcomes, and reduce harms? 


a. How do comparative benefits and adverse outcomes of interventions 
vary by subpopulations? 


b. How do comparative benefits and adverse outcomes of interventions 
vary by intervention characteristics? 
The analytic framework for the key questions is shown in Figure 1. 


Figure 1. Analytic framework for the Key Questions 
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Modifiers of effects 
Subpopulation (KQ 1a, 2a) 

* Gender/sex 

* Race/ethnicity 

* Age (early, middle and late adolescence) 
Intervention implementation characteristics (KQ 1b, 2b) 
* Family involvement 

* Peer involvement 


Methods 


The Evidence-based Practice Center conducted the review based on a systematic review (SR) 
of the scientific literature, using established methodologies as outlined in the Agency for 
Healthcare Research and Quality (AHRQ) Methods Guide for Effectiveness and Comparative 
Effectiveness Reviews.'® The PROSPERO registration number is CRD42018115388. 


Searching for the Evidence 


We conducted literature searches in MEDLINE, the Cochrane CENTRAL Trials Registry, 
Embase, CINAHL, and PsycINFO databases (all from inception) to identify primary studies 
meeting our criteria through April 11, 2019. As a part of an independent methods project, an 
interim search of MEDLINE was undertaken using text mining tools on October 30, 2018. A 
separate search for SRs of interventions for alcohol disorders/problematic alcohol use in the 
college setting was conducted in MEDLINE, Cochrane Database of Systematic Reviews, and 
Epistemonikos also through April 11, 2019; after discussion with the Technical Expert Panel 
(TEP), it was decided to restrict the review of this topic to existing SRs because the literature is 
vast and has been extensively reviewed. All search strategies are detailed in Appendix A. The 
search strategies were peer reviewed by an independent, experienced information 
specialist/librarian. We asked the TEP to provide citations of potentially relevant articles. We 
also perused the reference lists of published clinical practice guidelines and relevant existing SRs 
for eligible studies. We also searched ClinicalTrials.gov on October 30, 2018 to identify 
unpublished and ongoing studies, and the U.S. Food and Drug Administration (FDA) Web site 
on October 30, 2018 for pharmacologic trials. 

Peer and public review provided an additional opportunity for the TEP and other experts in 
the field to ensure that no key publications were missed. Finally, a Supplemental Evidence and 
Data for Systematic review (SEADS) portal and Federal Register Notice was posted for this 
review. 


Study Eligibility 


Table 1 and the following paragraphs detail the eligibility criteria. 
Population 


Adolescents 

We included studies of adolescents and young adults. Our a priori definition of this 
population’s age range was 12 to 20 years inclusive. Our search was designed to identify studies 
whose lower inclusion ages overlapped our age range of interest. Thus, we screened the full text 
of otherwise eligible studies that also included transition age youth (age 21 to 25) and adults (age 
18 and above) for reported subgroups. For studies of behavioral interventions, we excluded 
studies that enrolled more than 20 percent of subjects older than our a priori upper age of 20 
years. Because of the relative sparseness of studies of pharmacologic interventions, we expanded 
the upper inclusion age to 25 years inclusive. 


Substance Use-Related Eligibility Criteria 
We included studies that enrolled patients with substance use disorder(s) or problematic use 
of all substances except for tobacco. 


We included studies that enrolled participants with at least one substance use disorder 
diagnosis, or subjects with problematic use. 


Substance Use Disorder 

Studies were considered to have enrolled subjects with substance use disorder if subjects met 
DSM-III, DSM-IV or DSM-V criteria for one or more substance use disorders (except 
tobacco).!??! 


Problematic Use 

A designation of problematic use was applied if a study applied one or more of the following 
inclusion criteria: (1) subjects were referred for treatment by self, parent, school, other 
professional, or the juvenile justice system; (2) subjects were screened using a validated tool, 
such as the AUDIT-C (Alcohol Use Disorders Identification Test—Consumption)” and an 
intervention was given to those who met a prespecified threshold; (3) subjects were asked about 
amount and frequency of use, and a threshold of at least monthly substance use was defined or; 
(4) subjects were identified after a consequence of substance use, such as an alcohol related 
emergency department visit. 


Interventions and Comparators 


Each study of behavioral interventions was categorized as either brief (if the intervention 
consisted of one or two sessions), or nonbrief (defined as 3 or more sessions). The broad range of 
behavioral interventions were consolidated into combinations of seven primary intervention 
components and four intervention modifiers, based on components identified in prior SRs (see 
Intervention Coding below for details). 

Two distinct categories of pharmacologic interventions were considered: (1) medications 
used specifically to reduce and/or eliminate substance use and to prevent relapse, and (2) 
medications to treat co-occurring psychiatric disorders in patients with concurrent problematic 
substance use or substance use disorder. The latter set of medications were considered substance 
use treatments only if their effects on substance use were explicitly examined. 


Outcomes 


Use-related outcomes for specific substances (e.g., alcohol, cannabis) and outcomes that 
aggregated multiple substances were eligible for synthesis. We extracted continuous measures 
reflecting frequency of use and categorical measures of abstinence. For alcohol, we considered 
both frequency of heavy alcohol use (e.g., mean days of heavy use per 30 days) and frequency of 
any use (e.g., percent days of alcohol use per 30 days). 

Aggregate outcomes of use or abstinence for multiple substances were classified into one of 
three categories: (1) alcohol and other drugs, (2) illicit drug use (excludes alcohol, but includes 
cannabis and other drugs, regardless of local laws), (3) other drugs (which explicitly excludes 
alcohol and cannabis). 

A variety of substance use related problem scales were encountered, and they are detailed in 
Appendix H. When a study reported multiple problem scales that reflected problems associated 
with use of a specific substance, we chose the scale with the highest mean severity in each study. 


Study Designs 


For studies of behavioral interventions and of pharmacologic treatment of psychiatric 
comorbidities, we included only randomized controlled trials with a minimum of 10 patients per 


arm. 


For pharmacologic interventions of medications specifically to reduce and/or eliminate 
substance use and to prevent relapse, we included randomized controlled trials with a minimum 
of 10 patients per arm, and nonrandomized comparative studies or single group studies enrolling 
at least 100 patients per arm. 


Table 1. Eligibility criteria 


PICOTS 
Population 


Inclusion 
Adolescents 


Nonpharmacologic (12 — 20 years, inclusive) 
Pharmacologic (12 — 25 years, inclusive) 


Substance use disorder or problematic use of: 


Alcohol 

Cannabis 

Opioids, including nonmedical prescription and illicit 
Sedatives, hypnotics, or anxiolytics 

Stimulants, including nonmedical prescription and illicit 
Inhalants 

Hallucinogens 

Unspecified or polysubstance use 


Subpopulations of particular interest 


Psychiatric comorbidities 

Age subgroups (12-14, 15-17, 18-20 years) 
Sex, gender, and sexuality 

o Male/female, cis/transgender, orientation 
Racial/ethnic minority 


o ©. White 
o © African American/Other 
O Hispanic 


Socioeconomic status and related characteristics 

Pregnancy, postpartum, parenting 

Family characteristics 

o Demographics, family dynamics, involvement with 
child protection services 


Exclusion 

For nonpharmacologic studies, 
if >20% of study sample (or 
identifiable subgroup) is <12 or 
> 20 years, combined 

For pharmacologic studies, 
if >20% of study sample (or 
identifiable subgroup) is <12 or 
>25 years, combined 

Tobacco/nicotine use (including if 
the polysubstance use is 
predominantly tobacco/nicotine) 

Substance use not meeting 
definition of at least 
“problematic use” 


PICOTS Inclusion Exclusion 


Interventions Behavioral health treatments Preventive interventions (i.e., 
« Family therapies interventions among nonusers 
o Family behavioral therapy, family systems therapy, to prevent future substance use) 
brief strategic family therapy, functional family Interventions not aimed at 
therapy, ecological family therapy, multidimensional reducing substance use (é.g., 
family therapy, family systems network, educational needle exchange, condom 
family therapy, multisystemic therapy, others promotion) 
* Cognitive behavioral therapy Medications to treat overdose 
o Adolescent community reinforcement approach, Pharmacologic management of 
dialectical behavioral therapy, cognitive therapy, acute withdrawal symptoms 
others 


Contingency management 
Motivational interviewing or enhancement therapy 
* Psychoeducation (aimed at substance use) 
* Recovery support 
o  12-step programs, peer-based and/or peer supports, 
assertive continuing care, others 
¢ Other (e.g., culturally sensitive interventions) 
Multicomponent interventions (2 or more models) 
Integrated interventions (for substance use and a co- 
occurring disorder) 
¢ Behavioral interventions are divided by duration 
o Brief interventions (1 or 2 sessions only) 
o _Nonbrief interventions (23 sessions) 
Pharmacologic interventions 
« Medications used specifically to reduce and/or eliminate 
substance use and to prevent relapse 
o For alcohol 
=" Gabapentin, naltrexone, acamprosate, 
disulfiram, topiramate, ondansetron 
o Forcannabis 
» N-acetylcysteine 
o For opioids 
«Methadone, buprenorphine, combination 
buprenorphine and naloxone, naltrexone 
¢ Medications to treat co-occurring psychiatric disorders in 
patients with concurrent problematic substance use or 
substance use disorder (regardless of primary goal of 
treatment with the drug) 


Comparators Key Question 1 For Key Question 2, within- 
* No active treatment, including waitlist and placebo category comparisons, if differ 
¢ Treatment as usual (including if poorly defined) only in personnel (e.g., years of 
« Education or other materials (not aimed at substance therapist training) 
use) 


Key Question 2 
¢ Any other active intervention, including interventions both 
within a given category (e.g., comparing two types of 
cognitive behavioral interventions) 


PICOTS Inclusion Exclusion 
Outcomes Use outcomes None 

« Frequency of use (self report) 
o Days of use over specified time period 
o Heavy alcohol use days over specified time 

« Abstinence (objective or self-reported) 

* Severity of use 
o Substance-related problems or symptoms counts or 

scales 
Functional outcomes 

* School performance and educational attainment, 
including attendance, academic performance, 
graduation, entering higher education, and others 

* Social relationships, including family functioning, peer 
relationships, and others 

Harmful consequences of substance use 

* Serious mental health events, including suicidal ideation 
and behavior 

« Physical health, including mortality, substance-use- 
related morbidities, infections (e.g., HIV, hepatitis C, 
other sexually transmitted diseases) 

* Serious legal events, including arrest, recidivism, contact 
with juvenile justice system 

Adverse events of interventions 

« Side effects of pharmacologic interventions 

« Loss of privacy or confidentiality 

¢ Stigmatization or discrimination 

* latrogenic effects of group therapy due to peer deviance 


+ Other reported adverse effects ascribed to interventions 


Timing Minimum 1 month followup (since the start of the None 
intervention) 
Settings Any, including community, residential, jail/prison, court- College setting (for alcohol)* 


mandated, etc. 
Any country or geographic area 


Study All studies: Case control studies 
designs ¢ Published, peer-reviewed articles or unpublished data Cross-sectional studies 
from the FDA or from the Results reported on Case reports or series 


ClinicalTrials.gov web site 
« Any publication date 
For any intervention and outcome (except alcohol use among 
college students): 
* Randomized controlled trials 
« N210 per study group 
For pharmacologic studies reporting adverse events, as 
above and: 
« Nonrandomized comparative studies, prospective or 
retrospective, N2100 per study group 
* Single group, prospective or retrospective, N2200 
For studies of alcohol use among college students: 
* Systematic reviews of randomized controlled trials 
Publication Any Unable to read, translate, or 
language retrieve 


Abbreviations: FDA = Food and Drug Administration; N = sample size; PICOTS = populations, interventions, 
comparators, outcomes, timing, setting 


*Because we did a review of reviews for alcohol in the college setting, we excluded primary studies thereof. 


Screening Studies for Eligibility 


For citation screening, we initially conducted a series of pilot training sessions to achieve a 
satisfactory level of agreement among researchers regarding the nuances of the eligibility criteria 
for title and abstract screening. Because abstracts sometimes do not mention all outcomes that 
are reported in the full-text, we did not exclude titles and abstracts based on outcomes. We 
conducted all abstract screening using the open-source, online software Abstrackr 
(http://abstrackr.cebm.brown.edu/). To assist with screening, we used the predictive algorithm 
capabilities of Abstrackr, which frontloads more-likely-to-be-relevant citations. We began with 
double, independent screening of abstracts. Conflicts were resolved during full-group meetings. 
Using the labels (accept, reject) given to screened abstracts, Abstrackr determines a prediction 
value for all remaining unscreened citations and sorts these such that the most-likely-to-be- 
accepted abstracts are screened first. Based on empirical research on Abstrackr (soon to be 
submitted for publication), when all remaining unscreened abstracts have a prediction value 
<0.40 (on a scale of 0 to 1), these abstracts are highly likely (>99% probability) to be rejected. 
We, thus, double screened abstracts until this threshold was met; thereafter, we switched to 
single screening of remaining abstracts. 

We obtained the full-texts of all citations that were screened in (accepted) during abstract 
screening. The reference lists from SRs were reviewed for the presence of additional primary 
studies. We evaluated these articles using an evidence map structure, in which we gathered basic 
data on each article (i.e., study design, sample size, confirmation of substance use 
disorder/problematic use, age data, intervention(s), confirmation of outcomes of interest). 
Articles derived from the same studies (multiple publications, secondary analyses) were grouped. 
Using this process, we determined final eligibility status for each study. 


Data Extraction 


Studies with multiple publications or secondary analyses were extracted as one study. 
Multiple studies reported in a single publication were extracted separately. Small teams of 
researchers focused on extraction of different elements from each of the studies. One team 
extracted study design, population characteristics, and baseline data; one team extracted and 
categorized interventions (as described in the next section); one team extracted outcome 
descriptions and study results; one team extracted risk of bias information. Each section of each 
study was extracted by one researcher and then verified by at least one other experienced 
researcher. Discrepancies were discussed between them, as needed. 

Data were extracted into customized forms in the Systematic Review Data Repository 
(SRDR) online system (http://srdr.ahrq.gov) or into separate spreadsheets designed to capture all 
elements relevant to the Key Questions (KQs). Upon completion of the review, all data were 
uploaded to SRDR, and the SRDR database was made accessible to the public, with capacity to 
read, download, and comment on data. 

The basic elements and design of these forms are similar to those we have used for other 
comparative effectiveness reviews and include elements that address population characteristics; 
descriptions of the interventions and comparators; outcome definitions; intervention modifiers; 
sample sizes; study design features; funding source; results; and risk of bias. 

We did not contact study authors for additional data. 


Intervention Coding 


Each active intervention was categorized as either a brief (defined as 1 or 2 sessions) or 
nonbrief (defined as 3 or more sessions) intervention. To be classified as a “session” the 
adolescent had to connect directly with a therapy provider either in-person, by phone, or on the 
Web. Text message prompts or queries were not considered sessions. 

A codebook (Appendix C) with definitions for seven primary intervention components and 
intervention modifiers was developed by the Scientific Lead based on the most commonly 
reported approaches in prior SRs.”*?° The intervention components were: 

e Motivational interviewing (MI) 

e Family focused therapy (Fam) 
Cognitive behavioral therapy (CBT) 
Psychoeducation (Educ) 
Contingency management (CM) 
Peer group therapy (PeerGroup) 

e Intensive case management (ICM). 

Each study was independently coded by two investigators, one with expertise in adolescent 
substance use interventions and the other with expertise in the analysis of multi-component 
health service and behavior interventions. After assigning one or more intervention components 
to each study arm, the investigators reviewed and compared intervention codes and identified 
discrepant codes, which were discussed in detail with the goal of obtaining consensus. In cases 
when discrepancies were not resolved via discussion, a third senior investigator with expertise in 
adolescent substance use interventions reviewed the codes and served as the tie breaker. 

The coders assigned four intervention modifiers: delivery of therapy in groups, additional 
parent involvement, culturally accommodated treatment, and integrated interventions targeting 
both substance use and mental health. The definitions for the intervention components and 
modifiers are described below. 


General Principles 


The following principles guided intervention coding: 

a. Intervention components had to be unique and distinct from one another (e.g., if a 
CBT intervention described educating adolescents about skills, we did not code 
education unless there was a distinct psychoeducational session or module); 

b. Intervention components had to be sufficiently well described to ensure that all 
adolescents consistently received the treatment (e.g., if usual services was referral to 
an intervention or host of potential interventions but was not standardized to ensure 
all adolescents received it, we did not code the presence of the intervention 
component). Related, vaguely described intervention components lacking reference to 
a specific manual or another form of fidelity monitoring were not coded as having a 
component (e.g., intervention described as “motivational interviewing informed” or 
“cognitive behavioral therapy inspired”’); and 

c. Study arms that were reported as “treatment as usual” (TAU) were coded as having 
specific intervention components if the description treatment met the definition of the 
components and threshold criteria above. 
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Motivational Interviewing (MI) 


We coded an intervention as containing MI if it explicitly described at least one session 
focused on building the adolescent’s motivation to reduce substance use and/or attain abstinence. 
Motivation enhancement therapy (MET), a more structured and specific approach to building the 
adolescent’s motivation, was also categorized as MI. MET typically includes techniques, such as 
a decisional balance and personalized feedback on substance use patterns with normative 
comparisons, which are specifically designed to enhance motivation to change. 

Family, cognitive behavioral, and educational therapy models that generally referenced a 
goal to build the adolescent’s motivation to change were not coded as containing MI unless there 
was a stand-alone, manual-guided intervention MI component. If MI was delivered to the parent 
either instead of or in addition to the adolescent sessions, this was recorded and assigned a parent 
involvement qualifier. 


Family Therapy (Fam) 


We coded an intervention as containing family therapy if sessions were predominantly 
delivered with the entire family present and if the focus of the therapy was on changing the 
adolescent’s substance use by intervening with the entire family system. Interventions that were 
delivered predominantly to the adolescent and that contained parent-only sessions or periodic 
family check-ins were not categorized as family therapy. Building upon the classifications used 
in prior SRs (Becker & Curry, 2008; Hogue et al., 2018),”° 7” we assigned qualitative descriptors 
to describe family therapy models within five broad categories: ecological, systems/structural, 
behavioral, functional, and educational. These categories were assigned to enhance the 
qualitative description of distinct models but were not included in the quantitative synthesis. 

Ecological models explicitly targeted adolescent substance use in the context of extrafamilial 
influences across multiple interrelated, nested systems. Example intervention models included 
multidimensional family therapy, ecological family therapy, and multisystemic therapy. 

Systems/structural approaches attempted to restructure problematic family interaction 
patterns associated with the adolescent’s substance use. Systems/structural models included brief 
strategic family therapy, family systems therapy, and family structural therapy. 

Behavioral approaches were those that applied principles of operant conditioning and social 
learning within the family context in order to encourage healthy behavior and discourage 
substance use. 

Functional approaches integrated principles of both systems and behavioral approaches, such 
as functional family therapy. 

Educational approaches explicitly aimed to address the adolescent’s substance use through 
the provision of psychoeducation to the entire family. 


Cognitive Behavioral Therapy (CBT) 


We coded an intervention as containing CBT if it explicitly described using a manual or 
protocol focused on providing the adolescent with either cognitive (e.g., thought identification, 
thought modification) or behavioral (e.g., peer refusal, communication, problem solving) skills 
needed to reduce substance use and/or attain abstinence. CBT was only coded in adolescent- 
focused intervention components: family models that focused on building skills to change were 
coded as family behavioral therapy. Because all CBT models involve some degree of parent 
involvement, an intervention was coded as CBT if sessions were primarily delivered to the 
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adolescent alone (even if there were some parental involvement in the form of updates, parent 
only sessions, or parent check-ins) and categorized as family behavioral therapy if sessions were 
primarily delivered to the entire family. 


Peer Group Therapy (PeerGroup) 


Adolescent peer group therapy models were nondirective therapy interventions delivered to 
adolescents in group format, which aimed to reduce the adolescent’s substance use by having 
adolescents interact and provide social support. Interventions were coded as containing 
adolescent peer group therapy if the following two conditions were met: a) clear reference to 
therapy sessions delivered to adolescents in group format; and b) sessions were described as 
interactive, process-oriented, and/or following a self-help approach. Group therapy sessions that 
explicitly referenced a CBT or psychoeducational manual were not coded as peer group therapy: 
such approaches were coded as CBT or psychoeducation, respectively, and assigned the group 
therapy intervention modifier. 


Psychoeducation (Educ) 


Psychoeducational interventions were interventions explicitly designed to reduce the 
adolescent’s substance use through the provision of education about the harms of alcohol and 
illicit drugs. An intervention was coded as containing psychoeducation if it had an explicit stand- 
alone module focused on the provision of education. Because the majority of intervention models 
designed for the target population involve some degree of education about adolescent substance 
use, we only coded an intervention as containing psychoeducation if there was explicit reference 
to a stand-alone psychoeducation module or intervention. For example, family therapy, MI, and 
CBT models that made general reference to providing education to parents or teens were not 
coded as educational unless they had a clearly specified independent psychoeducation 
component. 


Contingency Management (CM) 


CM interventions explicitly described the provision of external, consistent reinforcement for 
the adolescent’s attainment of pre-defined goals. An intervention was coded as containing CM if 
it described a specific protocol (e.g., manual, prize schedule) for positive reinforcement of the 
adolescent’s behavior. Family therapy models that taught the parent how to monitor and 
reinforce the adolescent’s behavior through household contracts were not coded as containing 
CM unless the reinforcement was explicitly provided as a part of the therapy sessions: 
intervention approaches in which parents learned to provide reinforcement were coded as CBT 
or family behavior therapy. Additionally, we only coded an intervention as CM if the 
reinforcement was positive in nature: enforcement of negative consequences for missed sessions 
or positive urine screens (e.g., as part of family or drug court) were not considered CM. 


Intensive Case Management (ICM) 


Intensive case management interventions were interventions in which the primary focus was 
on linking the adolescent to supportive services. Interventions were coded as intensive case 
management if they identified specific protocols focused on promoting continuity of care (e.g. 
assertive continuing care). 
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Treatment as Usual (TAU) 


Interventions designed to be comparators to active intervention and were not directed at 
treating substance use were categorized as TAU. Examples included waitlists or pamphlets 
regarding issues other than substance use. In addition, interventions that were not adequately 
described, actively monitored for fidelity, or in which it was not possible to determine whether 
all adolescents received the same intervention, were coded as TAU. 


Intervention Modifiers 


In addition to coding primary intervention components, we coded several intervention 
modifiers, as follows: 

Group involvement. Therapy models were coded as group if any of the intervention elements 
were delivered in group format. This modifier encompassed a broader range of studies than the 
peer group therapy code. Studies that described parent-only groups and family groups were 
captured by this effect modifier, as were studies that described manual-driven CBT delivered in a 
group format or psychoeducational group therapy. 

Parent Involvement. Nonfamily models were coded as having substantial parent involvement 
if they specifically described delivering intervention elements to parents only (i.e., parent- 
focused intervention) or if they described frequent parent check-ins. 

Culturally accommodated. Therapy models that were specifically designed as adaptations for 
specific cultural groups were classified as culturally accommodated. Models had to explicitly 
reference being adapted for specific cultural groups or using formative work with specific 
cultural populations to receive this designation. 

Integrated interventions. Interventions that were specifically designed to target co-occurring 
substance use and mental health diagnoses were coded as integrated. This modifier was only 
coded if the intervention was explicitly designed to address dual substance use and mental health 
diagnoses. If the sample had high proportions of dual diagnosis patients, but the intervention did 
not specify a specific focus on diagnoses of interest, then this modifier was not coded. Similarly, 
if the intervention targeted substance use and a co-occurring physical health concern such as HIV 
or sexual risk, then this modifier was not coded. 


Assessment of Risk of Bias 


Two senior investigators, highly experienced in SR and risk of bias assessment, assessed the 
risk of bias for all studies. After two rounds of double, independent risk of bias assessment, with 
adjudication of 10 studies per round, the remaining studies were assessed by one investigator and 
verified by the other (each was the primary assessor for about half the studies). 

We assessed the risk of bias (methodological quality) of each study based on predefined 
criteria. For all studies, we used the Cochrane risk of bias tool,”’ which examines methodological 
items, such as random sequence generation; allocation concealment; blinding of participants, 
care providers, and outcome assessors; incomplete outcome data; and selective reporting, to 
inform judgments about various sources of bias and overall risk of bias assessments. We also 
assessed whether intention-to-treat analyses were conducted. In addition, we used relevant 
questions from the Newcastle Ottawa Scale,’ including similarity of groups at baseline, whether 
any cointerventions differed between groups, absolute and comparative compliance, timing of 
outcome assessments (between groups), and any additional biases. 
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If a randomized trial used an “urn method” for randomization (used to balance groups among 
prespecified participant characteristics) we assumed that randomization method and allocation 
concealment were low risk of bias (since randomization would need to be done centrally by 
computer). For outcome assessor blinding of nonpharmaceutical interventions, we assessed 
whether the outcome assessors were blinded to intervention group; if so, we determined these 
studies were low risk of bias for outcome assessor blinding (even though the adolescent users 
reporting substance use to the outcome assessor may not have been blinded). For incomplete 
outcome data (attrition bias) and compliance, we deemed studies to be high risk of bias if more 
than 20 percent of participants dropped out or did not comply with the intervention, regardless of 
whether intention-to-treat analyses were conducted. Regarding selective outcome reporting, we 
captured information from available protocols (including from ClinicalTrials.gov) on planned 
outcomes. For group similarity, we captured information about the statistical significance of 
differences between groups at baseline; if there were differences, but these were statistically 
accounted for in analyses, we deemed these to be low risk of bias. 

For SRs of interventions for alcohol use disorder or problematic alcohol use in the college 
setting, we assessed SR quality using specific items from AMSTAR 2 (A Measurement Tool to 
Assess Systematic Reviews, version 2).°° We omitted questions about SR protocol timing, 
justification of excluded studies, study funding sources, and assessment of publication bias. Also, 
two questions about description of eligibility criteria were combined as were two questions about 
assessment of risk of bias in their analyses were combined. Thus, the risk of bias questions (with 
corresponding item numbers in AMSTAR 2) included: description of eligibility criteria (item 1), 
comprehensive search strategy (item 4), duplicate study screening (item 5), duplicate data 
extraction (or with verification) (item 6), adequate description of details of included studies (item 
8), use of a satisfactory technique for assessing risk of bias in included studies (item 9), 
appropriate meta-analysis methods (if applicable) (item 11), assessment of potential impact of 
risk of bias (item 12), explanation and discussion of any heterogeneity (item 14), and reporting 
of SR conflict of interest (item 16). We deemed that SRs that meta-analyzed (standardized) 
“effect sizes” across disparate outcomes did not address the KQs of our systematic review 
because they indiscriminately combined highly heterogeneous outcomes. Furthermore, some SRs 
included multiple outcomes from the same underlying trials without correction for correlation or 
for double-counting. 

For all studies, any quality issues pertinent to specific outcomes within a study were noted 
and applied to those outcomes. Quality issues pertinent to specific outcomes within a study were 
noted and considered when determining the overall strength of evidence (SoE) for conclusions 
related to those outcomes. 

Detailed risk of bias assessments for each study are listed in Appendix H. A summary of the 
risk of bias for the studies in each group eligible for meta-analysis is displayed in a stacked bar 
chart. 


Data Synthesis 


Frequency of use outcomes were reported in multiple forms. If use was reported as days of 
use per time interval (e.g., days of use per month, percent use days per 90 days), mean use was 
converted to a common metric of mean use days per 30 days, despite the acknowledged caveat 
that this metric assumes that use was constant over the various reporting intervals. 

We preferentially included outcomes evaluated at 4 months after baseline assessment. If 
outcomes were not reported at 4 months, we accepted the closest followup time in the range from 
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1 to 6 months (in the case of ties, e.g. data available for both 3 months and 5 months, we chose 
the earlier time). Abstinence outcomes were summarized as odds ratios. 

For continuous outcomes with an available baseline data scale, we evaluated the “net mean 
difference” (NMD) of the outcome, the difference between arms of the within-arm changes in 
outcome. 

When necessary, standard errors (SE) of the differences were estimated from reported 
standard deviations (or SEs) of baseline and final values. For parallel trials, we assumed a 
correlation of 0.5 between baseline and final values in patients receiving a given intervention. 
Thus, we used the following equation to estimate the SE: 

SE’ difference = (SEa)* + (SEp)* — 2:t-(SEa)-(SEx) 
where r=0.5 (the assumed correlation) and A and B index the correlated measurements (baseline 
and final time points). 

Standardized net mean differences (SNMD) were calculated for substance use problem 
scales. In a sensitivity analysis, we calculated standardized net mean differences (SNMD) to 
enable combined analyses of: 1) scales that reflected (intensity of) substance use, and 2) 
nonlinear transformations, e.g. square root of mean use days, and substance specific days of use 
outcomes. 

A minority of studies did not report either standard continuous or categorical outcome 
metrics, but instead either summarized models with metrics that could not be converted to net 
difference, odds ratio, or risk ratio, or reported only statistical significance (with or without 
directionality). These were not included in the quantitative analysis and are not explicitly 
summarized in the review text. Their results are included in the Evidence Tables and, 
electronically, in the SRDR project file. 


Qualitative Evidence Synthesis 


Prior to meta-analysis, with input from subject matter experts, we qualitatively evaluated 
whether populations were sufficiently comparable for quantitative synthesis. 

We assessed population comparability in two ways. First, we identified the study inclusion 
criteria to determine whether each study targeted alcohol, cannabis, another drug, or a 
combination of substances. Next, we assessed substance use reported in the recruited samples. 
Although study eligibility criteria were heterogeneous in terms of targeted substances; the final 
samples were predominantly comprised of adolescents with some combination of alcohol and 
cannabis use, with a minority using other drugs. Studies that specified substances other than 
alcohol and cannabis in their eligibility criteria (e.g. ecstasy or cocaine,*! methamphetamine,” 
inhalants**) were excluded from meta-analyses. 

The vast majority of studies reported overlapping substance specific outcomes (i.e., a given 
study might report cannabis outcomes, alcohol outcomes or both). We analyzed these outcomes 
separately by substance. Thus, a given study might contribute to a cannabis analysis, to an 
alcohol analysis, or to both. Some studies only reported an aggregate use measure, e.g., alcohol 
and other drug use or illicit drug use. 

Substance use problem scales were combined and pooled across substances. 


Quantitative Evidence Synthesis 


We conducted pairwise meta-analyses (MA) using both frequentist and Bayesian frameworks, 
and network meta-analyses (NMA) in the Bayesian framework. Analyses were done using R,*4 
with the metafor*> and gemtc packages.*° 
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MAs used a random effects model assuming that within-study estimates and between studies 
true effects are normally distributed. 

NMA is an extension of pairwise meta-analyses that simultaneously combines direct (when 
interventions are compared head-to-head) and indirect (when interventions are compared through 
other reference interventions) evidence. We performed NMA when more than three studies 
formed a connected network. Combining the direct and indirect evidence not only improves 
precision of estimates, but also provides estimates for all pairwise comparisons, including those 
missing from the direct evidence. The key assumption of the network meta-analysis is that of 
consistency of direct and indirect effects. Consistency is likely to hold when the distribution of 
effect modifiers is (equivalently, patient characteristics are) similar across trials. If this 
assumption is violated, there may be inconsistency between the direct evidence and indirect 
evidence of treatment comparisons.*7 

Our NMA used a hierarchical model with a within-study level and a between-studies level 
that models responses at the arm level and nests arms within studies. We ran two sets of 
analyses, one assuming consistency of treatment effects and one examining this assumption. The 
models are shown in Appendix I Briefly, the analysis assuming consistency parameterizes 
treatment effects as linear combinations of 7-1 parameters, where T is the number of treatments 
in the network. Treatment effects are assumed to be normally distributed across studies with a 
common variance (i.e., are homoscedastic random effects). We used noninformative default 
priors on study-level mean treatment effects. Specifically, priors on the means were zero- 
centered normal distributions, with standard errors 15 times larger than the observed scatter of 
study effect estimates. 

We used empirical prior distributions for the between-study heterogeneity variance. For 
outcomes modeled on the log odds ratio scale, we assigned a log-normal hyperprior for the 
between-study heterogeneity variance based on empirical results from meta-epidemiological 
analyses of nonpharmacologic trials with subjective outcomes.*® *? For continuous outcomes 
(NMD and SNMD) we used inverse gamma priors based on analogous empirical results 
nonpharmacologic studies of mental health outcomes.*° We performed a sensitivity analysis 
using alternative priors for the between-study variance. 

In gemtc, estimation is done with MCMC via the JAGS*' sampler, using initial values drawn 
randomly from the marginal distributions of the priors of respective parameters. We fit four 
MCMC chains. After a burn in of 5000 iterations, we monitored convergence of random effects 
means and variances automatically, by checking every 10,000 iterations whether the Gelman 
Rubin diagnostic was less than 1.05 with 95 percent probability for all monitored parameters. 
After convergence was reached, an extra 10,000 iterations were run. All models converged 
within 10000 iterations. Model fit was assessed by comparing the posterior mean of the residual 
deviance to the number of data points. The ratio of residual deviance to number of data points in 
the various models was very close to 1 (within 5%), suggesting adequate model fit. 

For each analysis, we empirically assessed if the network meta-analysis consistency 
assumption was violated by comparing the direct and indirect evidence using a node-splitting 
approach.” To this end, for each comparison that is informed by both direct and indirect data, we 
separately parameterized the direct and indirect effects, and compared the estimates of the two. 
Although these analyses were not suggestive of inconsistency (not shown), in sparse networks, 
like the ones in this report, they can be underpowered. 
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Results are presented in terms of net mean or standardized net mean differences and 
corresponding 95 percent credible intervals (CrI). We preferentially report net mean differences 
for substance specific and aggregated (over multiple substances) use days. 

Using the sampled posterior distribution of effects, we estimated the probability that a 
treatment is the most effective, second most effective, and so on, based on the results of the 
network meta-analyses. We report the surface under the cumulative ranking curve (SUCRA), 
which represents a single number ranging from 0 to 100 percent associated with each 
intervention. The higher the SUCRA value (closer to 100%), the higher the likelihood that an 
intervention is in the top rank or one of the top ranks. As SUCRA values approach 0 percent, it is 
more likely that an intervention is in the bottom rank, or one of the bottom ranks. 

We performed an additional sensitivity analyses by comparing of an additional analysis of 
standardized net mean differences which combined use days with scales and nonlinear 
transformations relating to use days. Results were similar with the main analysis (not shown). 

Statistical heterogeneity was explored qualitatively. Because of the relatively small number 
of studies, and the little variability in characteristics, meta-regression and subgroup analyses 
were not performed. 


Grading the Strength of Evidence for Major Comparisons and 
Outcomes 


We graded the strength of the body of evidence (SoE) as per the AHRQ methods guide on 
assessing the SoE.“ For conclusions based on NMA of sparse networks, we provided a 
qualification, and downgraded the SoE due to lack of precision and directness, as applicable. 

We assessed the SoE for comparisons of major interventions (i.e., behavioral intervention 
methods, pharmacologic interventions, and combinations) to no treatment (TAU) and to each 
other. 

To our knowledge, there is no information on the minimal clinically importance differences 
for the outcomes we consider. The commonly used conventions for standardized mean 
differences similarly do not translate to minimally importance differences.* 

For each evaluated comparison, we assessed the number of studies, their study designs, the 
study limitations (i.e., risk of bias and overall methodological quality), the directness of the 
evidence to the KQs, the consistency of study results, the likelihood of reporting bias, in addition 
to the precision and magnitude of the effect estimated across studies using NMA. When at least 3 
direct comparisons were available, we compared effects estimated from direct comparisons 
(using both frequentist and Bayesian random effect models), with effects obtained from Bayesian 
NMA. 

If the Bayesian NMA random effect models (direct and indirect evidence) were consistent 
with the pairwise (direct), the effect size and precision from the NMA informed SoE ratings. For 
sparse networks with few direct comparisons, we downgraded the SoE by one category. In these 
cases consistency is rated as unclear. 

Outcomes with highly imprecise estimates, highly inconsistent findings across studies, or with 
data from only one study were deemed to have insufficient evidence to allow for a conclusion (with 
the exception that particularly large, generalizable single studies could provide at least low SoE). 
This approach is consistent with the concept that for imprecise evidence “any estimate of effect is 
very uncertain,” the definition of Very Low quality evidence per GRADE.*° 

Based on these multidimensional assessments, we assigned a SoE rating as being either high, 
moderate, low, or insufficient. 
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Assessing Applicability 
We assessed the applicability within and across studies with reference to adolescents in the 
populations of interest (i.e., type and severity of abuse and setting).*” 
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Results 


As illustrated by the flow diagram in Figure 2, we found 118 randomized controlled studies 
that evaluated treatment of adolescents with problematic substance use or substance use 
disorders. Excluded studies, along with reasons for exclusion, are listed in Appendix B. 


Figure 2. Literature flow diagram 


Citations retrieved 
(MEDLINE, EMBASE, Cochrane,CINAHL/PsychINFO, clinicaltrials.gov) 


n=33,272 


Excluded in abstract screening 
n=31,441 


Excluded in full text screening 
n=626 


Full text articles retrieved 
n=1,831 * Includes adults > 25 years (n=35) 
: * Includes transition-aged youth 
(non-pharmacological 


: interventions) (n=55) 
Full text articles prescreened + Not all subjects with at least 


for population, excluded problematic use (n=146) 
n=988 * No extractable or relevant data 
for interventions/outcomes of 
interest (nN=202) 
« Alcohol interventions in college 
setting (n=9) 
* RCT, N < 10 per arm (n=9) 
* NRCS (nonpharm, pharmacological 
interventions N < 100) (n=85) 
* Case control/cross sectional (n=7) 
* Single arm nonpharm or pharm 
N < 200 (n=46) 
* Review (n=31) 
¢ Retracted article (n=1) 


Included studies: N=118 in 217 articles and records 


In a separate search for systematic reviews (SR) of interventions for problematic alcohol use 
in the college setting, we screened 401 abstracts, of these we screened 42 papers in full text, of 
which 36 were excluded (18 were reviews of preventive interventions, 10 were not in college 
students, 6 were not SRs, and 2 were not focused on alcohol users). This left 6 SRs that were 
deemed informative for our narrative summary. 


Qualitative Categorization 


Among studies of behavioral interventions, brief (2 or fewer sessions) and nonbrief (3 or 
more sessions) were qualitatively distinct. On initial review of the eligible studies, we found that 
participants in the brief intervention studies had problematic use, whereas nonbrief behavioral 
intervention studies enrolled adolescents with diagnosed substance disorder(s). In addition, the 


19 


interventions provided in nonbrief studies were much more intensive. Therefore, we considered 
these groups of studies separately in our quantitative synthesis. 

Despite superficial heterogeneity of study inclusion criteria with respect to the targeted 
substance(s), most studies enrolled adolescents using some combination of alcohol and cannabis, 
with a minority using other drugs. 

The 3 studies that specified use of substances other than alcohol and cannabis in their 
eligibility criteria are briefly described in brief *!-*? and nonbrief ** sections, but were excluded 
from meta-analyses. 

The following substance-specific outcomes were evaluated for possible meta-analysis: heavy 
alcohol use days, alcohol use days, alcohol abstinence, cannabis use days and cannabis 
abstinence. In addition, studies reported aggregate outcomes reflecting abstinence for, or use of 
multiple substances. These outcomes included: alcohol and other drug use (AOD), illicit drug 
use and other drug use. In addition, we considered substance use problem scales within brief 
and nonbrief categories. Appendix D lists baseline and interventions. Appendix E identifies the 
outcomes reported by each study and Appendices F and G report detailed results for brief and 
nonbrief interventions, respectively. Outcomes with sufficient data for an outcome (bulleted 
below) were meta-analyzed and reported. 


Brief Behavioral Interventions 


e Alcohol 
o Heavy alcohol use days 
o Alcohol use days 
o Abstinence from alcohol 
e Cannabis 
o Cannabis use days 
o Cannabis Abstinence 
e Substance use problem scales 
(Legal outcomes) 


Nonbrief Behavioral Interventions 


e Alcohol 
o Alcohol use days 
e Cannabis 
o Cannabis use days 
e Aggregate drug use 
o Alcohol and other drug use 
o Illicit drug use days 
(Other outcomes: school performance and education attainment, family-related, peer- 
related, mental health events, physical health events and legal outcomes) 

The results in subsequent sections describe less commonly reported outcomes and are not 
meta-analyzed. We first briefly review of systematic reviews of interventions for alcohol use in 
the college setting. 

Finally, we separately describe two categories of pharmacologic interventions. 

1. Studies of medications to reduce and/or eliminate and/or to prevent relapse in adolescents 

with opioid, alcohol, and cannabis use disorders. In studies that combined pharmacologic 
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and behavioral interventions, the behavioral interventions were often less completely 
described, and therefore not easily compared to the detailed manual based interventions 
typical in behavioral trials. Drug trials included placebo arms, which due to the likelihood 
of a placebo effect, were not deemed comparable to TAU arms in studies of behavioral 
interventions. Thus, we did not jointly synthesize studies of behavioral interventions with 
studies of pharmacologic interventions and summarize these studies separately by use 
disorder. 

2. Studies of medications targeting specific co-occurring psychiatric disorders in patients 
with a substance use disorder(s). Given that effects on substance use may depend on how 
effectively the underlying psychiatric disorder was treated, we reported scales reflecting 
the severity of the psychiatric disorder in addition to substance use related outcomes. 


Brief Behavioral Interventions 


Key Points 


Key points from the meta-analyses are summarized below. 

e Motivational interviewing (MI) 
co Reduces days of heavy alcohol use compared to TAU (low SoE) 
co Reduces days of overall alcohol use compared to TAU (moderate SoE) 
co Does not reduce days of cannabis use compared to TAU (moderate SoE) 
o Reduces substance use problems compared to TAU (low SoE) 


Thirty-six studies (in 64 papers; sample size range, 33 to 1449) 31:32. 48-109.31, 32, 49-52, 54-69, 71-111 
published between 1982 and 2019, evaluated effects of brief behavioral interventions in 
adolescents (mean age range, 14.8-18.9 years). Thirty-three studies enrolled participants with 
problematic use of alcohol, cannabis, and/or other drugs and three enrolled adolescents with a 
diagnosed substance use disorder. Appendix D (Table D-1) provides baseline and intervention 
details. Each of these studies each had methodological concerns including lack of outcome 
assessor blinding and incomplete outcome data. Most of the studies evaluated interventions we 
have coded as MI. Within-study descriptions varied, the intervention most commonly would be 
classified as Motivational Enhancement Therapy (MET). There was some variation in the 
number of sessions, the length of individual sessions, and the background and training of the 
interventionalist. Detailed results are presented by outcome in Appendix F. 


Studies Not Included in Meta-Analyses 


Enrolled for Use of Substances Other Than Alcohol or Cannabis 

Two two-arm studies, published between 2006 and 2011, assessed adolescents with 
problematic use of specific substances other than alcohol or cannabis and evaluated brief 
behavioral interventions (Table 2).*!** Adolescents in the studies were on average 15 to 18 years 
of age (range across studies, 14-22). The studies each had methodological concerns including 
lack of outcome assessor (or other) blinding, incomplete outcome data, poor compliance with the 
interventions, and others. 

Each study was unique regarding substance used. The primary substances of misuse under 
study were ecstasy and cocaine *! (problematic use: at least four times over the past month) and 
methamphetamine *” (use disorder per DSM-IV). 
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Neither study reported significant differences in mean number of use days or abstinence 
between adolescents who received active behavioral interventions and those who received 
treatment as usual or non-substance use disorder-related education. In the Marsden 2006 study, 
those receiving the brief intervention had slightly higher rates of abstinence, but it did not 
exclude the null effect — for cocaine (RR 1.17, 95% CI 0.94 to 1.46) and for abstinence from 


crack cocaine (RR 1.12, 95% C1 0.99, 1.26).?! 


In the small study of methamphetamine users, adolescents in both the brief MI and education 
groups used methamphetamine on average about | or 2 days per 30 days with no statistically 
significant difference between groups. About 50 to 60 percent of adolescents were abstinent at 1 


and 2 months, with no statistically significant difference between groups.* 


Table 2. Results: Brief behavioral interventions for substances other than alcohol or cannabis 


Study Arm 1 Arm 2 Outcome Time Arm 1 Arm 1 Arm 2.N Arm 2 Calculated 
Author, Point N Analyzed Outcome Analyzed Outcome Effect 
Year, (Months) (95% Cl) 
PMID 
Marsden Ml TAU Ecstasy use (days) 6 166 8.2 (13.5) 176 8.7 (13.2) Diff -0.5 
(2006) (mean, SD) (-2.8, 3.0) 
Alcohol use (days) 6 166 28.9 (25.7) 176 30.7 (25.3) Diff -1.8 
(mean, SD) (-7.2, 3.6) 
Cocaine use (days) 6 166 5.54 (11.5) 176 74 (12.6) Diff -1.9 
(mean, SD) (-4.4, 0.7) 
Crack use (days) 6 166 4.67 (15.5) 176 5.7 (15.8) Diff -1.0 
(mean, SD) (-4.3, 2.3) 
Cannabis use 6 166 52.0 (36.5) 176 57.2 (36.3) — Diff -5.2 
(days) (mean, SD) (-12.9, 2.5) 
Abstinent from 6 166 428 176 43.8 RR 0.98 
ecstasy (%) (0.77,1.25) 
Abstinent from 6 166 51.8 176 44.3 RR 1.17 
cocaine (%) (0.94, 1.46) 
Abstinent from 6 166 81.3 176 72.7 RR 1.12 
crack cocaine (%) (0.99, 1.26) 
Srisurapa- MI (Brief, Educ Methamphetamine 1 24 1.57 (1.77) 24 0.97 (1.2) Diff 0.6 
nont Motivation use (days) (mean, (-0.3, 1.5) 
(2007) Building) sD 
Methamphetamine 2 24 1.97 (1.31) 24 1.1 (1.2) Diff 0.11 
use (days) (mean, (-0.8, 1.0) 
SD) 
Abstinent from 1 24 62.5 24 58.3 RR 1.07 
stimulants (% 0.68, 1.69 
Abstinent from 2 24 54.2 24 62.5 RR 0.87 
stimulants (%) (0.54, 1.40) 


Abbreviations: CBT = cognitive behavioral therapy; CI = confidence interval; Diff = difference; Educ = psychoeducation; MI = 
motivational interviewing; RR = risk ratio; SD = standard deviation; TAU = treatment as usual 


Studies with Nondistinguishable Arms Excluded From Meta-Analysis 


Three two-arm studies (in 7 papers) of brief behavioral interventions (Table 3 


84 87, 88, 101-104 


compared interventions that were not distinguishable by our taxonomy, precluding inclusion in 


the meta-analysis. 
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Table 3. Brief behavioral intervention studies with two treatment arms with nondistinguishable 


components 
Author, Year Nondistinguished No. Distinguishing Intervention Features 
Intervention Arms 
Component(s) 
Spirito, 2011 8788 = MI 2 MI with separate family-focused MI session 
vs. 
MI with youth only 
Smith, 2015 & MI 2 MI with normative feedback vs. 
MI without normative feedback 
Walker, 2016 1°1- CBT+Ml 2 Motivational check-in vs. 
104 Assessment only check in 


Abbreviations: CBT = cognitive behavioral therapy; MI = motivational interviewing; No. = number study arms 


Studies Eligible for Meta-Analysis 

There were 31 studies**®?: 85: 86 89-100, 105-109 eligible for meta-analysis, of which 24 were two- 
arm studies and seven were three-arm studies. One study,”’ reported 12-month outcomes only, 
and was not included in the meta-analyses. 

In six three-arm studies (Table 4), two arms were not distinguishable using our coding 
schema. The nondistinguished treatment arms were pooled and included in meta-analyses. 


Table 4. Brief behavioral intervention studies with three treatment arms with two 
nondistinguishable components that were pooled in MA 


Author, Year Nondistinguished #Arms__ Distinguishing Intervention or Control 
Component Features 

Winters, 2007 1% MI 3 Ml with separate family-focused MI 
session vs. MI with youth only vs. TAU 

Winters, 2012 196 Ml 3 Ml with separate family-focused Ml 

109 session vs. MI with youth only vs. TAU 

Spijkerman, 2010 Ml 3 Ml with normative feedback vs. MI 

85 without normative feedback vs. TAU 

Dembo, 2014 6669 MI 3 Ml with separate family-session vs. MI 
with youth only vs. TAU 

Cunningham, 2015 = Ml 3 Computer-delivered MI vs. therapist- 

gia: delivered MI vs. TAU 

Peterson, 2006 8 TAU 3. Assessment only (TAU) vs. Assessment 


(TAU) followed by MI 
Abbreviations: MA = meta-analysis; MI = motivational interviewing; TAU = treatment as usual; # arms =number of arms 


The variations in active interventions (MI or MI+CBT) compared in the nine studies with 
duplicate arm codes included delivery method (computer vs. therapist),°*" post-intervention 
check-ins (motivational check-in vs. no check-in),'°'!™ target recipient (parents/family vs. 
adolescents only),°” 8* !°>-!°? or content (MI with normative feedback vs. without)**. 


Risk of Bias 


Risk of bias summaries are presented graphically in Figure 3 for the 30 studies that we 
considered eligible for meta-analysis. The most common methodological concerns involved lack 
of blinding of participants, personnel, and outcome assessors. 
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Figure 3. Meta-analyzed brief behavioral intervention studies: Percentage of studies in each risk of 
bias category 


Random sequence generation 
Allocation concealment 
Blinding of participants 

Blinding of personnel 
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Incomplete outcome data 
Selective reporting 
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Co-interventions 
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Alcohol Outcomes 


Heavy Alcohol Use Days 

Seven studies compared MI with TA and reported a measure of heavy 
alcohol use in 2,821 participants. Of these, five studies*° >” >>” © !° (1,248 subjects), reported 
heavy use days and two studies**® *? 8° (1,573 subjects), reported a scale (Figure 4).** °° 


U8. 52, 55-57, 64, 86, 105 
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Figure 4. Evidence graph for brief behavioral intervention studies reporting heavy alcohol use 
days 


@« 


m @ 


The network plot consists of nodes (yellow circles) representing the interventions being compared and edges (connecting lines) 
representing the available direct comparisons between interventions. Each edge represents a within study comparison. Dotted 
edges represent comparisons reported as scales. Abbreviations: TAU = treatment as usual; MI = motivational interview 


Key Question 1: Heavy Alcohol Use Days — MI Compared With TAU 

As shown in Figure 5, MI relative to TAU has a net mean difference (NMD) of —0.7 (95% 
CrI —1.6, 0.02) days/month of heavy alcohol use. These results correspond to a Bayesian 
posterior probability that MI is better than TAU is 97.3 percent. 

MI is more effective than TAU in reducing heavy alcohol use days. We rated the strength of 
evidence (SoE) as low. 


Figure 5. Heavy alcohol use: Forest plot depicting individual study effects with summary 
estimates of the relative effect of MI versus TAU 


Author, Year NMD [95% Cl/Crl] 
Arnaud, 2017 a -0.6 [-1.2, -0.1] 
Bernstein, 2010 —— -1.0 [-1.9, -0.1] 
Colby, 2018 - rs -2.0 [-3.4, -0.5] 
D'Amico, 2018 + -0.1 [-0.4, 0.3] 

Winters, 2007 me -0.7 [-1.3, -0.2] 


REML RE (direct) — : -0.7 [-1.1, -0.2] 
Bayes RE (direct) ———— -0.7 [-1.6, 0.0] 


40 -3.0 -20 -10 00 1.0 
Net Mean Difference (days) 


NMD < | favors MI. Abbreviations: NMD = net mean difference; REML = restricted maximum likelihood, RE = random effect; 
CI/CrI = credible interval (for Bayes RE Model); direct = direct (pairwise) comparisons. 
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Alcohol Use Days 

Ten dual-arm studies enrolled a total of 3,726 subjects and reported a measure of the 
frequency of alcohol use (Figure 6). Of these eight studies?” °457: %: 78-81, 105-109 (2.153 subjects) 
reported use days and two studies** *” 8° (1573 subjects) reported a scale. One trial, that enrolled 
326 subjects compared MI with Educ and reported use days.’**° 


Figure 6. Evidence graph for brief behavioral intervention studies reporting alcohol use days 


Educ C) 
mui @ 


TAU 


The network plot consists of nodes (yellow circles) representing the interventions being compared and edges (connecting lines) 
representing the available direct comparisons between interventions. Each edge represents a within study comparison. Dotted 
edges represent comparisons reported as scales. Abbreviations: TAU = treatment as usual; MI = motivational interview; Educ = 
education 


Key Question 1: Alcohol Use Days — MI Compared With TAU 

The studies contributing direct evidence for the MI versus TAU comparison are illustrated in 
Figure 7. The pooled NMD of direct comparisons of MI vs TAU was —1.2 (95% CrI, —2.2, —0.2 ) 
days/month of alcohol use, compared to those in TAU groups. 

In the NMAs, the pooled NMD for the MI versus TAU comparison was -1.1 (95% CrI —2.2, 
—0.3) days/month of alcohol use. 

MI is more effective than TAU in reducing overall alcohol use days. We rated the overall 
SoE as moderate. 
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Figure 7. Alcohol use days: forest plot depicting individual study effects with summary estimates 
of the relative effect of MI versus TAU 


Author, Year NMD [95% Cl/Crl] 
Bernstein, 2010 ——— -0.8 [-2.0, 0.4] 
Brown, 2015 —= -2.1 [-3.6, -0.7] 
Colby, 2018 — a -2.6 [-4.4, -0.8] 
D'Amico, 2018 = -0.2 [-0.7, 0.2] 
McCarty, 2019 —i— 0.2 [-0.6, 1.0] 
Winters, 2007 HH -1.2 [-1.7, -0.7] 
Winters, 2012 —— $1 -2.4 [-3.5, -1.3] 


REML RE (direct) —_—_ -1.2 [-2.0, -0.4] 

Bayes RE (direct) —_—_ -1.2 [-2.2, -0.2] 

Bayes RE (network) —— -1.1 [-2.2, -0.3] 
PT TT TT TT 


-5.0 -3.0 -1.0 1.0 
Net Mean Difference (days) 


NMD < 1 favors MI. Abbreviations: MI = motivational interviewing; TAU = treatment as usual, REML = restricted maximum 
likelihood, RE = random effect; CI = confidence interval, CrI = credible interval (for Bayes estimates). 


Key Question 2: Alcohol Use Days — Comparative Effect of MI Versus Educ 
As shown in Table 5, the estimated NMD for MI versus Educ was 0.3 (95% CrI —2.5 to 3.1) 
days/month (insufficient SoE). 


Table 5. Brief behavioral interventions and alcohol abstinence: Net mean difference of days per 
month of abstinence between all interventions 


Intervention Educ MI TAU 
Educ Educ 0.3 1.4 
(-2.5, 3.1) (-1.4, 4.4) 

Ml -0.3 MI 1.1 
(-3.1, 2.5) (0.3, 2.2) 

TAU -1.4 -1.1 TAU 


(44,14) — (-2.2, -0.3) 


Gray cells display comparisons for which there is indirect evidence only. Effects are expressed as NMD (days/month), with 95% 
credible intervals in parentheses. 


Abbreviations: Educ = psychoeducation; MI = motivational interviewing; TAU = treatment as usual. 


Alcohol Abstinence 


Abstinence for alcohol was reported by seven studies with outcomes for 2,482 participants 
(Figure 8).48 49:54, 72, 76-80, 89, 106-109 
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Figure 8. Evidence graph for studies reporting alcohol abstinence 


en 
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The network plot consists of nodes (yellow circles) representing the interventions being compared and edges (connecting lines) 
representing the available direct comparisons between interventions. Each edge represents a within study comparison. 
Abbreviations: MI = motivational interviewing; TAU = treatment as usual; Educ = education 


Key Question 1: Alcohol Abstinence — MI Versus TAU 

The studies contributing direct evidence for the MI versus TAU comparison for the odds 
ratio of attaining abstinence are illustrated in Figure 9. When direct comparisons of MI vs TAU 
were considered, the odds of abstinence were 2.0 (95% CrI 0.9, 7.8) fold higher for MI than for 
TAU. In the NMA, the pooled odds ratio 1.9 (95% CrI 0.9, 6.). 

MI may be more effective than TAU. However, the credible intervals for both the pairwise 
NMA are wide, and also compatible with no effect (insufficient SoE). 


Figure 9. Alcohol abstinence: MI (brief intervention) versus TAU 


Odds Ratio 
Author, Year [95% Cl/Crl] 
Arnaud, 2015 = 1.3 [1.0, 1.6] 
Brown, 2015 0.6 [0.3, 1.2] 
Martinez Martinez, 2008 19.2 [1.0, 360.5] 
McCambridge, 2004 Le 5.7 (0.7, 47.3] 
Winters, 2012 a 2.8 [1.5, 5.3] 
REML RE (direct) toni 1.8 (0.8, 4.4] 
Bayes RE (direct) —— 2.0 [0.9, 7.8] 
Bayes RE (network) — 1.9 [0.9, 6.1] 


ee ee ee | 
01 10 74 546 403.4 


Odds Ratio (log scale) 
Odds ratio > 1 favors MI. Abbreviations: MI = motivational interviewing; TAU = treatment as usual, REML = restricted 
maximum likelihood, RE = random effect; CI = confidence interval; CrI = credible interval (for Bayesian RE Model) 
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Key Question 2: Comparative Effects of MI and Educ 

The comparative effects, as log odds ratios are shown in Table 6. 

The estimated effect for Educ versus MI is highly imprecise, with direct evidence from 2 
studies only (insufficient SoE). 


Table 6. Brief behavioral interventions and alcohol abstinence: Odds ratios for abstinence 
between all interventions 


Intervention Educ MI TAU 
1.3 0.7 

Educ Educ (0.4, 46) (0.1, 26) 
0.8 0.5 

my (0.2, 2.8) ” (0.2, 1.1) 
TAU he a TAU 


(04,9.0)  (0.9,5.9) 


Gray cells display comparisons for which there is indirect evidence only. Effects are expressed as odds ratios with 95% credible 
intervals in parentheses. 


Abbreviations: Educ = psychoeducation; MI = motivational interviewing; TAU = treatment as usual 


Cannabis Outcomes 


Cannabis Use Days 
13 studies analyzed cannabis use days (none reported a scale) in 2,386 participants. 
65, 71, 78-81, 83, 89, 99, 100, 106-109 The network geometry is shown in Figure 10. 


51, 53, 54, 64, 


Figure 10. Evidence graph for brief behavioral intervention studies reporting cannabis use days 


om @ 


TAU 


The network plot consists of nodes (yellow circles) representing the interventions being compared and edges (connecting lines) 
representing the available direct comparisons between interventions. Each edge represents a within study comparison. 
Abbreviations: MI = motivational interviewing; TAU = treatment as usual; Educ = education 
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Key Question 1: Cannabis Use Days 


MI Compared With TAU 
Figure 11 is a forest plot of the 10 studies that performed direct comparisons between MI and 
TAU. Based on pairwise comparisons only, the direct estimate of NMD was —0.2 (95% CrI -1.4, 
0.5) days/month. The effect estimate from the NMA was —0.05 (95% CrI —0.3, 0.1) days/month. 
MI is not more effective than TAU. We rated the SoE as moderate. 


Figure 11. Cannabis use days: Forest plot of net mean difference for MI (brief intervention) versus 
TAU 


Author, Year NMD [95% Cl/Crl] 
Bernstein, 2009 se -3.2 [-8.1, 1.7] 
Braciszewski, 2018 }—e--—___ -2.2 [-12.3, 7.9] 
Brown, 2015 en -0.5 [ -4.3, 3.3] 
D'Amico, 2018 a 0.1 [ -0.5, 0.7] 
Martin, 2008 ——_-—___— -6.3 [-14.2, 1.6] 
McCarty, 2019 ms 0.8 [ -1.0, 2.7] 
Peterson, 2006 — 0.5 [ -4.1, 5.1] 
Walker, 2011 ay -3.5 [ -6.3, -0.6] 
Walker, 2006 }-—»—-—4 -2.3 [-7.1, 2.5] 
Winters, 2012 —— 0.6 [-1.7, 2.9] 
REML RE (direct) > -0.5 [ -1.6, 0.6] 
Bayes RE (direct) @ -0.2 [-1.4, 0.5] 
Bayes RE (network) ( -0.0 [-0.3, 0.1] 
TT TT TTF 


-15.0 -5.0 0.0 5.0 
Net Mean Difference (days) 


NMD < 1 favors MI. Abbreviations: MI = motivational interviewing; CBT= cognitive behavioral therapy; Educ = education; 
TAU = treatment as usual; CI/CrI = 95% confidence interval/Bayesian credible interval; REML = restricted maximum likelihood 
estimation; RE = random effect; Bayes = Bayesian analysis; direct = pairwise comparisons only; network = from network meta- 
analysis 


Cannabis Use Days —Educ Compared With TAU 
The effect estimates for Educ versus TAU are based on a single direct comparison and have 
wide credible intervals (insufficient SoE). 


Key Question 2: Cannabis Use Days — MI Versus Educ 
Based on pairwise comparisons only, the direct estimate of NMD was —0.2 (95% CrlI -2.4, 
1.2) days/month. The effect estimate from the NMA was —0.2 (95% CrlI: —2.2, 1.7) days/month. 
As shown in Figure 12, the credible intervals are wide for the effect of MI versus Educ 
(insufficient SoE). 
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Figure 12. Cannabis use days: Forest plot of net mean difference for the brief interventions Ml 
versus Educ 


Author, Year NMD [95% Cl/Crl] 
de Gee, 2014 a 0.0 [-4.6, 4.6] 
McCambridge, 2008 —— -0.3 [-3.2, 2.6] 
Spirito, 2017 rr 0.0 [-6.6, 6.6] 
Walker, 2011 —— -1.4 [-4.3, 1.5] 
REML RE (direct) — -0.6 [-2.4, 1.2] 
Bayes RE (direct) —— -0.7 [-2.4, 1.2] 
Bayes RE (network) a -0.2 [-2.1, 1.7] 


_ i —! | J 
-10.0 -5.0 0.0 5.0 10.0 


Net Mean Difference (days) 


NMD < 1 favors MI. Abbreviations: MI = motivational interviewing; Educ = education; TAU = treatment as usual; CI/CrI = 95% 
confidence interval/Bayesian credible interval; NMD = net mean difference; REML = restricted maximum likelihood estimation; 
RE = random effect; Bayes = Bayesian analysis; direct = pairwise comparisons only; network = from network meta-analysis 


Cannabis Abstinence 
Six studies reported the cannabis abstinence outcomes in 1,119 participants (Figure 13).°!** 
76-80, 89, 106-109 CF these, two studies compared MI with a control group who received Educ.7*°° 8° 


Figure 13. Evidence graph for brief behavioral intervention studies reporting cannabis abstinence 
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The network plot consists of nodes (yellow circles) representing the interventions being compared and edges (connecting lines) 
representing the available direct comparisons between interventions. Each edge represents a within study comparison. 
Abbreviations: Educ = education, MI = motivational interviewing, TAU = treatment as usual 


Key Question 1: Cannabis Abstinence 


MI Versus TAU 
Figure 14 illustrates the study level effects for each of the 4 studies that compared MI and 
TAU. The summary estimate from the NMA was 1.5 (95% CrI: 0.7 to 3.4). 
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The credible interval for this estimate is wide and does not exclude no effect or an adverse 
effect. Therefore, we rated the SoE as insufficient. 


Figure 14. Cannabis abstinence: Forest plot of log odds ratio for MI (brief intervention) compared 
with TAU 


Odds Ratio 
Author, Year [95% Cl/Crl] 
Bernstein, 2009 2. 1.1 [0.4, 3.7] 
Brown, 2015 —— 0.6 [0.3, 1.2] 
McCambridge, 2004  — 3.9 [1.2, 12.0] 
Winters, 2012 —_— 2.2 (1:2, 3:9] 
REML RE (direct) = 1.5 [0.7, 3.3] 
Bayes RE (direct) a 1.5 [0.7, 3.4] 
Bayes RE (network) a 1.5 [0.7, 3.4] 


0.1 04 1.0 2.7 7.4 20.1 
Odds Ratio (log scale) 


Odds ratio > 1 favors MI. Abbreviations: MI = motivational interviewing; Educ = education; TAU = treatment as usual; CI/CrI = 
95% confidence interval/Bayesian credible interval; REML = restricted maximum likelihood estimation; RE = random effect; 
Bayes = Bayesian analysis; direct = pairwise comparisons only; network = from network meta-analysis 


Key Question 2: Cannabis Abstinence — Comparative Effects of MI Versus Educ 
The credible interval for the indirect estimate of the Educ vs TAU effect was similarly 
imprecise. 
As shown in Table 7, the odds ratio for abstinence between MI versus Educ is 2.0 (95% Crl 
0.7, 7.4). We rated the SoE as insufficient due to imprecision. 


Table 7. Brief behavioral interventions and cannabis abstinence: Odds ratios for abstinence 
between all interventions 


Intervention Educ MI TAU 
2 1.4 

Educ Educ (0.7, 7.5) (0.4, 6.3) 
0.5 0.7 

Ml (0.1, 1.4) Ml (0.3, 1.5) 
TAU ae Us TAU 


(0.2, 2.8) (0.7, 3.4) 


Gray cells display comparisons for which there is indirect evidence only. Effects are expressed as odds ratios with 95% credible 
intervals in parentheses. Abbreviations: Educ = psychoeducation; MI = motivational interviewing; TAU = treatment as usual 


Substance Use Problem Scale 
Nine studies, with the comparisons show in Figure 15, reported one of 8 substance use 
p gu p 
problem scales in 1,854 participants. °>57: %- 6 71, 78-80, 100, 105-109 
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Figure 15. Evidence graph of brief behavioral intervention studies reporting a substance use 
problem scale 
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The network plot consists of nodes (yellow circles) representing the interventions being compared and edges (connecting lines) 
representing the available direct comparisons between interventions. Each edge represents a within study comparison. 
Abbreviations: Educ = education, MI = motivational interviewing, TAU = treatment as usual 


Key Question 1: Substance Use Problem Scales 


MI Compared With TAU 

Figure 16 illustrates the study level effects for each of the 6 studies that compared MI and 
TAU. Based on pairwise comparisons only, the SNMD was -0.5 (95% CrlI -1.25, 0.2). The 
pooled estimate from the NMA was —0.5 (95% CrI —1.0 to 0), similar to the direct estimates that 
included the 3 studies that compared MI with Educ was -0.4 (95% CrI -1.0, 0.01). 

ML is better than TAU in reducing substance abuse related problems. We rated the SoE as 
low. 
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Figure 16. Substance use problem scales: Forest plot of standardized net mean difference of the 
brief interventions MI versus TAU 


Author, Year SNMD [95% Cl/Crl] 
Arnaud, 2017 He -0.2 [-0.4, 0.1] 
Colby, 2018 ee: -0.5 [-0.8, -0.2] 
D'Amico, 2018 = 0.0 [-0.2, 0.2] 
Martin, 2008 _— -0.5 [-1.2, 0.1] 
Winters, 2012 se -0.2 [-0.5, 0.1] 
Winters, 2007 —— 4.7 1-22, -1.1] 


REML RE (direct) ee -0.5 [-0.9, -0.0] 
Bayes RE (direct) a -0.5 [-1.2, 0.2] 
Bayes RE (network) —_ -0.5 [-1.0, 0.0] 
Li ol. 1 wl 
-2.5 -1.5 -0.5 0.5 


Standardized Net Mean Difference 
SNMD < 1 favors MI. Abbreviations: Educ = education, MI = motivational interviewing, TAU = treatment as usual; SMD = 
standardized mean difference; CrI = credible interval 


Educ Compared With TAU 

No studies directly compared Educ with TAU. The SNMD for this effect was -0.5 (95% Crl 
—1.4, 0.32). 

We rated the SoE as insufficient, due to imprecision. 


Key Question 2: Substance Use Problem Scales — MI Versus Educ 

Figure 17 illustrates the study level effects for each of the 3 studies that directly compared 
MI with Educ. The pairwise random effect estimate of the SNMD was 0.04 (95% CrI —0.1, 0.2). 
The SNMD of 0.04 obtained from the NMA that included all studies was identical to the 
pairwise estimate. However, this estimate (not shown in Figure 17 had a much wider credible 
interval, from -0.6 to 0.7. 

We rated the SoE as insufficient, due to imprecision. 


Figure 17. Substance use problem scales: Forest plot of standardized net mean difference of the 
brief interventions MI versus Educ 


Author, Year SNMD [95% Crl] 
de Gee, 2014 ———— 0.0 [-0.4, 0.4] 
McCambridge, 2008 -——/#—— 0.0 [-0.2, 0.3] 
Walker, 2011 — 0.1 [-0.2, 0.4] 
REML RE (direct) ee 0.0 [-0.1, 0.2] 
Bayes RE (direct) — 0.0 [-0.1, 0.2] 


0.4 -0.2 00 02 04 


Standardized Net Mean Difference 


SNMD < 1 favors MI. Abbreviations: SNMD = standardized net mean difference; CrI = credible interval; REML = restricted 
maximum likelihood; RE = random effect; direct = estimated from pairwise comparisons only. 


Legal Outcomes 

One study (McCambridge 2003) compared Motivational Interviewing (MI) and Treatment 
As Usual (TAU) and provided data on adolescents’ self-reported selling of drugs to their friends 
and to non-friends. As detailed in Table 8, more adolescents in the MI group than the TAU group 
sold drugs to their friends (40% vs. 15%; OR=3.7, 95% CI 1.8 to 7.5). 


Table 8. Legal outcomes with brief behavioral interventions 


Author, Year Intervention Control Time Sold Drugs Sold Drugs Sold Sold Sold Sold 
PMID Label Label (Months) _ to Friends to Friends Drugs to Drugs to Drugs to Drugs to 
Friends Non- Non- Non- 
friends friends friends 
Int. Cont. Calc. Int. Cont. Calc. 
Effect Effect 
95% Cl 95% Cl 
McCambridge Motivational Treatmentas 3 40% 15% OR 3.7 14% T% OR 2.2 
200376. 77 Interviewing usual (N=97) (1.8, 7.5) (0.8, 5.9) 
(N=82) 


Abbreviations: Calc. = calculated; CI = confidence interval; Cont. = control; Int. = intervention; OR = odds ratio 
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Nonbrief Behavioral Interventions 


Key Points 


Key points from the meta-analyses of nonbrief behavioral interventions are summarized by 
outcome below. 


Nonbrief Behavioral Interventions by Outcome 
e Days of alcohol use 
o Limited, primarily indirect evidence, suggests that family focused therapy (Fam) may 
reduce days of alcohol use relative to TAU (low SoE) 
o Limited, primarily indirect evidence suggests that family focused therapy (Fam) may 
be more effective than ICM, CBT and MI in reducing days of alcohol use (low SoE). 

e Days of cannabis use 

o Limited, primarily indirect evidence, suggests that CBT, CBT+MI and 
CBT+MI+CM, Educ) may result in relative increases relative to TAU in days of 
cannabis use (low SoE) 

e Days of alcohol and other drug use (AOD) 

o Limited, primarily indirect evidence suggests that both MI and CBT may reduce days 
of AOD use relative to TAU (low SoE) 
o MI was more effective than PeerGroup, CBT+MI, Fam, CBT+ICM, CBT+MI+ICM, 
CBT and ICM (low SoE) 
e Days of illicit drug use 
o Limited, primarily indirect evidence, suggests that CBT+MI reduces days of illicit 
drug use relative to TAU (low SoE) 

There were 59 studies in 103 studies (sample size, range 26 to 514), which enrolled 8,786 
participants with substance use disorders involving alcohol, cannabis and other drugs.!® 33: !!2-71 
Table 10 provides baseline and arm details. 

Of these, there were 44 two-arm studies, 12 three-arm studies and 3 four-arm studies. Across 
studies, there were a total of 136 arms, of which 97 were coded as a single intervention, 
including TAU (29 arms), Fam (25 arms), CBT (19 arms), MI (5 arms), PeerGroup (10 arms), 
Educ (6 arms), ICM (2 arm), and CM (1 arm). The remaining 39 arms were coded as compound 
interventions (two or more separate components). Details of baselines and interventions are 
given in Appendix D (Table D-2). Detailed results are presented by outcome in Appendix G. 


Studies Including Arms With Nondistinguished Intervention Codes 


Thirteen nonbrief behavioral intervention studies (5 two-arm studies [Table 9]; 8 multi-arm 
studies [Table 10]) evaluated different variants of CBT, MI, Fam, Peer group, and TAU 
components (or their combinations) not captured by our taxonomy, and therefore have two arms 
with the same coding (i.e., they are nondistinguishable in our categorizations). 
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Table 9. Nonbrief behavioral intervention studies with two treatment arms with nondistinguishable 
components 


Author, Year Nondistinguished No. Studies Distinguishing Comparison of Interest 
Intervention Component(s) 

Amini, 1982 "8 TAU 2 Outpatient vs. inpatient care. Both interventions were too 
poorly specified to warrant coding of components. 

Schaeffer, 2013 187 Building apprenticeship program vs. standard vocational 
education 

Burrow-Sanchez, CBT 2 CBT culturally adapted for Latino youth population vs. 

2012 115 standard CBT 

Burrow-Sanchez, CBT culturally adapted for Latino youth population vs. 

2015 116. 117 standard CBT 

Rohde, 2014 182, 183 CBT+Fam 1 Sequencing and combined effects of CBT and Fam. 


Evaluated CBT followed by Fam, Fam followed by CBT, 


and CBT combined with Fam concurrently 
Abbreviations: CBT = cognitive behavioral therapy; Fam = family therapy; TAU = treatment as usual 


Table 10. Nonbrief behavioral intervention studies with multiple treatment arms with 
nondistinguishable components 

Study Author, Year, | Components Studied No. Studies —_ Distinguishing Component of Interest 

PMID 


Kaminer, 2008 146148 = CBT+MI vs. 1 In-person MI vs. telephone MI vs. TAU 
CBT+MI vs. 
TAU 

Dennis, 2004 120 CBT+MI vs. 1 CBT+MI for 5 sessions vs. CBT+MI for 12 sessions vs. CBT+MI for 
CBT+MI vs. 12 sessions with parent group education and case management 
CBT+MI+Educ+ICM 

Stanger, 2015 200 CBT+MI vs. 1 CBT+MI vs. CBT+MI+CM vs. CBT+MI+CM with additional parent 
CBT+MI+CM vs. sessions 
CBT+MI+CM 

Robbins, 2008 173 Fam vs. 2 Family therapy using a systems/structural model vs. family therapy 
Fam vs. using an ecological model vs. TAU 
TAU 

Slesnick, 2009 19 Family therapy using a functional model vs. family therapy using an 

ecological model vs. TAU 

Joanning, 1992 138 Fam vs. 2 Family therapy using an educational model vs. family therapy using 
Fam vs. a structural model vs. youth-only group therapy 
PeerGroup 

Liddle, 2001 1% Family therapy using an educational model vs. family therapy using 

an ecological model vs. youth-only group therapy 

Henggeler, 2006 125 Peer group vs. 1 Family court with usual community services (including peer group 
PeerGroup vs. therapy) vs. drug with usual community services (including peer 
Fam+PeerGroup vs. group therapy) vs. drug court combined with family therapy using 
Fam+CM+PeeerGroup an ecological model and peer group therapy vs. drug court 


combined with family therapy using an ecological model and peer 
group therapy and contingency management 
Abbreviations: CBT = cognitive behavioral therapy; CM = contingency management; Educ = psychoeducation; Fam = family 
therapy; ICM = intensive case management; MI = motivational interviewing; TAU = treatment as usual 


Substances Other Than Alcohol or Cannabis 


One 2-arm study *° summarized in Table 11, enrolled adolescents with inhalant use and 
evaluated a 4-session CBT-based intervention with an educational component. The authors 
concluded that adolescents who received CBT and education were about 3 times more likely to 
be abstinent at 1 year than those who received education alone (16% vs. 5%; RR 3.20, 95% CI 
1.34 to 7.65).°3 


3] 


Table 11. Results: Nonbrief behavioral interventions for substances other than alcohol or 
cannabis 


Study Arm 1 Arm 2 Outcome Time Point Arm 1 Arm 1 Arm 2N Arm 2 Calculated 
Author, (Months) N Analyzed Outcome Analyzed Outcome Effect 
Year, (95% Cl) 
PMID 
Ogel CBT_Educ Educ Abstinent from 12 31 16 31 5 RR 3.20 
(2011) 3 (Nonbrief, inhalants (N) (1.34, 7.65) 

Cognitive 

Behavioral/E 

ducational) 


Abbreviations: CBT = cognitive behavioral therapy; Cl = confidence interval; Diff = difference; MI = motivational 
interviewing; RR = risk ratio; SD = standard deviation; TAU = treatment as usual 


Risk of Bias 


Risk of Bias summaries are given in Figure 18 for the 53 studies that were eligible for meta- 
analysis. Each of these studies had methodological concerns, most prominently lack of blinding 
of participants and personnel and compliance. 


Figure 18. Meta-analyzed nonbrief behavioral intervention studies: Percentage of studies in each 
risk of bias category 

Random sequence generation 

Allocation concealment 

Blinding of participants 

Blinding of personnel 

Blinding of outcome assessor 

Incomplete outcome data 

Selective reporting 

Intention to treat analysis 

Group similarity at baseline 

Co-interventions 


Compliance 


Timing of outcome assessments 


0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% 
BLowrisk of bias @Unclearrisk of bias mHigh risk of bias 


Network Meta-Analyses 
Alcohol Outcomes 


Alcohol Use Days 

Eleven studies, comprised of eight dual-arm and three multi-arm studies as illustrated in 
Figure 19, enrolled 2,248 subjects and reported a measure of mean alcohol use days. Of these, 
two studies!”* 7 reported a scale. 


Figure 19. Evidence graph for nonbrief behavioral intervention studies reporting mean alcohol use 
days 


CBT+MI 
CBT+MI+ICM O 


Fam+PeerGroup 


© 
CBT+ICM@) 


TAU ) PeerGroup 


es) Fam+CM+PeerGroup 


ICM 


Abbreviations: MI = motivational interviewing; Fam = family focused therapy; CBT = cognitive behavioral therapy; CM = 
contingency management; PeerGroup = peer group therapy; ICM = intensive case management; TAU = treatment as usual 


Key Question 1: Alcohol Use Days — Behavioral Interventions Compared With 
TAU 

Figure 20 illustrates that net mean differences (NMD) from the network meta-analysis 
(NMA) for the 10 interventions evaluated. Note, however, that the network is sparse, and the 
comparisons between different treatments are often based on a series of single-study indirect 
comparisons. Because the network is not densely connected (most indirect comparisons rely on a 
small set of RCTs) and because most RCTs are small, the statistical power to detect 
inconsistency between direct and indirect effects is very limited. Thus, estimates of treatment 
effectiveness are very imprecise. 

Fam was more effective than TAU. Participants who received Fam versus TAU had an NUD 
of —3.5 (95% CrI —6.9, -0.4) days of alcohol use per month. We rated the associated SoE for this 
effect as low. 

There is insufficient evidence regarding the relative effects of the other interventions 
compared with TAU. 
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Figure 20. Alcohol use days: Summary forest plot of meta-analyzed net mean difference for all 
interventions studied compared with TAU 


Intervention NMD [95% Crl] 
CBT 5 2.9 [-1.2, 7.4] 
CBT+ICM —@— -0.4 [-2.9, 1.7] 
CBT+MI -@— -0.2 [-2.3, 1.8] 
CBT+MI+ICM —@o— -0.2 [-3.0, 2.5] 
Fam —e— -3.5 [-6.9, -0.4] 
Fam+CM+PeerGroup > -1.5 [-7.1, 4.2] 
Fam+PeerGroup 1+ 0.6 [-4.7, 6.1] 
ICM ae 3.4 [-1.1, 8.2] 
MI — 1.3 [-2.1, 4.9] 
PeerGroup +» —__ 1.1 [-3.4, 5.7] 

(ea: a oe | oe ao 


8.0 -40 00 4.0 8.0 
Net Mean Difference (days/mo.) vs. TAU 


NMD < | favors intervention relative to TAU. Abbreviations: NMD = net mean difference; MI = motivational interviewing; Fam 
= family focused therapy; CBT = cognitive behavioral therapy; CM = contingency management; PeerGroup = peer group 
therapy; ICM = intensive case management; TAU = treatment as usual; CrI = Bayesian credible interval. 
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In Table 13, the interventions are ranked by the surface area under the cumulative ranking curve 
(SUCRA). The higher the SUCRA value (closer to 100%), the higher the likelihood that an intervention is in 
the top rank or one of the top ranks. As SUCRA values approach 0 percent, the more likely that an 
intervention is in the bottom rank, or one of the bottom ranks.* The last three columns summarize the 
probability that each intervention ranks in the top third, middle third, and bottom third, respectively. There is 
a 95 percent chance that Fam ranks in the top third, a 91 percent chance that ICM ranks in the bottom third, 
and an 88 percent chance that CBT is in the bottom third with respect effects on overall alcohol use days. 


Table 13. Probabilities of nonbrief behavioral interventions ranking in top third, middle third and bottom third 
to reduce alcohol use days 


Intervention(s) SUCRA _ Top third Middle third Bottom third 
Fan (it HCH 
“Fam+CM+PeerGroup=—i(iéd79% = (iti‘iHi(i(‘éza OC 

CBT+ICM 66% 36 51 14 
“CBM titi (‘ia “™SC*O*‘(‘(‘=‘CSC*‘(‘i®S 
“CBTHMHICM (iti HSC‘ ‘!SC*”*”*”*”:CO CT 
‘TAUUtti<i~=i‘“‘zaHSO!:COCUlUM 
“Fam+PeerGroup (iti) (tit 
“PeerGroup = (ast (ats ti SCS 
Mo oMOHS—<“<i<“ TC 
“CAT i si Hs—<i~<~iti‘“‘“S™SOC‘ésSCS!S! RF 
IM i‘ mBNOCO*!;C;*dSlUB UT 


Abbreviations: CBT = cognitive behavioral therapy; CM = contingency management; Fam = family therapy; ICM = intensive case management; 
MI = motivational interviewing; PeerGroup = peer group therapy; SUCRA = surface area under the cumulative ranking curve; TAU = treatment 
as usual 


Cannabis Outcomes 


Cannabis Use Days 

Eleven studies reported cannabis use days (none reported a scale reflecting use days).!!* 118 124-126, 135, 151, 
154-161, 165-172, 200, 204, 208, 209 The network of treatment comparisons shown in Figure 21 for the nine dual-arm 
and two multi-arm, with 1,643 participants included in this network meta-analysis. 
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Figure 21. Evidence graph for studies reporting cannabis use days 
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Abbreviations: Fam = family; CM = contingency management; TAU = treatment as usual; CBT = cognitive behavioral therapy; ICM = intensive 
case management; MI = motivational interviewing; Educ = education. 


Key Question 1: Cannabis Use Days — Behavioral Interventions Compared With TAU 
Compared to TAU, we cannot conclude that any of interventions studied reduced cannabis use days 
(Figure 22). All point estimates of treatment effects, except for CBT+ICM and Fam+PeerGroup, were 
positive, consistent with an increase in cannabis use days. 
However, the credible intervals were generally wide. As was the case in the previous analysis, the network is 
very sparse and loosely connected, and because most RCTs are small, the statistical power to detect 
inconsistency between direct and indirect effects is very limited. Thus, estimates of treatment effectiveness 
are very imprecise. 
One intervention (CBT), and two combined interventions (CBT+MI and CBT+MI+CM) increased 
cannabis use days relative to TAU. We rated the associated SoE for this conclusion as low. 
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Figure 22. Cannabis use days: Summary forest plot of meta-analyzed net mean differences for all interventions 
compared with TAU 


Intervention NMD [95% Crl] 
CBT — 4.2[ 0.7, 7.5] 
CBT+Fam —— 1.3 [-7.0, 10.0] 
CBT+ICM oo -2.6 [-7.5, 2.2] 
CBT+MI a nr ee 10.5 [ 4.0, 17.4] 
CBT+MI+CM  -——e—__—4 10.8 [ 4.1, 17.8] 
CBT+MI+Fam (a 4.8 [-2.1, 11.9] 
Fam @: 1.4 [-1.0, 3.8] 
Fam+CM+PeerGroup ee 0.2 [-6.4, 7.2] 
Fam+PeerGroup —— -0.7 [-7.5, 5.9] 
MI be 3.3 [-1.9, 8.6] 
PeerGroup -——e— 3.1 [-2.3, 8.6] 


-10.0 0.0 10.0 20.0 
Net Mean Difference (days/mo.) vs. TAU 


NMD <1 favors intervention versus TAU. Abbreviations: MI = motivational interviewing; Fam = family focused therapy; CBT = cognitive 


behavioral therapy; CM = contingency management; PeerGroup = peer group therapy; ICM = intensive case management; TAU = treatment as 
usual; CrI = credible interval 


Key Question 2: Cannabis Use Days — Comparative Effects of Behavioral Interventions 
Table 14 enumerates the relative effects of all interventions and interventions combinations studied. Most 
of the results in the table are based on indirect data, with direct data limited to one or two studies. The 
statistical power to detect inconsistency between direct and indirect effects is very limited. Thus, estimates of 
treatment effectiveness are imprecise. 
Given that we cannot conclude that any of interventions studied reduced cannabis use days compared to 
TAU, and the limitations noted above, we rated the SoE for all comparative effects as insufficient. 
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These patterns are reflected in the rankings, Table 15, which estimates that TAU has a 79 percent 
chance of being in the top third of all interventions. 


Table 15. Probabilities of nonbrief behavioral interventions ranking in top third, middle third and bottom 
third to reduce cannabis use days 


Intervention(s) SUCRA Top Third Middle Third ) Bottom Third 
CBT+ICM 91% 91 8 1 
aA — — ee = GR RE 0 
“Fam+CM+PeerGroup = (74%O—C“‘Ci«*;*«s;*S:SS 8 8 
a 2 
CBT+Fam 66% A cd 24 
cer t—(‘ lB 
CBT+MI+Fam 43% 10 30 60 


CBT+MI+CM 12% 0 1 | 99 


Abbreviations: CBT = cognitive behavioral therapy; CM = contingency management; Educ = psychoeducation; Fam = family therapy; 
ICM = intensive case management; MI = motivational interviewing; SUCRA = surface area under the cumulative ranking curve; TAU = 
treatment as usual 
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Alcohol and Other Drug Use 

Eight studies reported aggregate use days for alcohol and other drugs by 1,202 
participants, with comparisons illustrated in Figure 23.!!?- 119. 127 139, 141, 142, 162, 189, 194, 195 Qe 
of these studies, with 32 subjects, reported a scale that reflected aggregate alcohol and drug 
use.'4!. '4 There were six dual-arm studies and two multi-arm studies. 


Figure 23. Evidence graph for studies reporting aggregate alcohol and other drug use days 


CBT+ICM 


@ C) CBT+MI+ICM 


CBT+MI 


@ TAU 
MI 
© @- © 


Fam 


PeerGroup C) ICM 


Key Question 1: Aggregate Alcohol and Other Drug Use — Behavioral 
Interventions Compared to TAU 

Overall the precision of estimates was low (Figure 24). This network is very sparse and 
loosely connected, and because most RCTs are small, the statistical power to detect 
inconsistency between direct and indirect effects is very limited. Estimates of treatment 
effectiveness are very imprecise. 
Of the interventions compared, MI and CBT were more effective than TAU. We rated the 
associated SoE as low. 
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Figure 24. Aggregate alcohol and other drug use: Summary forest plot of meta-analyzed net 
mean differences for all interventions compared with TAU 


Intervention NMD [95% Crl] 


CBT —e—' 4.9 [-9:1,-0,4) 
CBT+ICM eo -1.4[-4.4, 1.6] 
CBT+MI -@— 0.1 [ -2.7, 2.9] 
CBT+MI+ICM = -1.5[-4.5, 1.6] 
Fam -@— -0.1 [ -3.0, 2.8] 
ICM ee -4.3 [-10.4, 1.2] 
MI ae 2 -9.3 [-15.4, -3.5] 
PeerGroup ——— 1.8 [ -5.7, 9.0] 
TTT) 


-16.0 -8.0 -2.0 4.0 10.0 
Net Mean Difference (days/mo.) vs. TAU 


NMD < | favors intervention versus TAU. Abbreviations: MI = motivational interviewing; Fam = family focused therapy; 
CBT = cognitive behavioral therapy; CM = contingency management; PeerGroup = peer group therapy; ICM = intensive 
case management; TAU = treatment as usual; CrI = credible interval 


Key Question 2: Aggregate Alcohol and Other Drug Use — Comparative 
Effects of Behavioral Interventions 

Table 16 details the comparative effects the studied interventions in studies reporting 
aggregate alcohol and other drug use outcomes. When the interventions are ranked, MI has 
the highest probability (0.98) of ranking in the top third (Table 17). Most of the results in the 
Table are based on indirect data, with direct data limited to only one or two studies. The 
statistical power to detect inconsistency between direct and indirect effects is very limited. 
Thus, estimates of treatment effectiveness are very imprecise. 

MI was more effect than CBT+MI, Fam, and CBT. We rated the associated SoE as low. 
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Table 17. Probabilities of nonbrief behavioral interventions ranking in top third, middle third 
and bottom third to reduce aggregate alcohol and other drug use days 


Intervention(s)  SUCRA TopThird Middle Third spec 
wM””~«SOG:C“‘CO(‘#‘O“CN’”#C#C#C*C‘COONS;*C;é‘(‘“C;C‘*COS 
“cBaT. (t;””COHOC~<Cs~s‘“‘“i‘<‘W’SC*C‘(‘(‘(‘(#éSMSC(‘CS#SSNSCOQZCSU 
ICM 76% 75 18 7 
“CBTMHICMt(i‘iwSOC(‘“ C“‘;SCTCO#;‘ia ‘“CNS”*O*;*;*«AA; 
“CBTHCM—i(<‘éér!!~OOUOU!€C«dSUU!!C«wO”~*~«*S 
“Famn”~*~<“‘t;~s*éstHSC~C“‘“‘(S*st*S*~‘SC‘éS”*”*”:CW*S 
‘TUUt*é~<“‘<‘iéNSO*C“‘C(‘<;‘i‘;‘(‘(‘(‘(<‘<‘é !S;*;*;*;*SS 
“CBM (iti aOOC“‘ ;‘(C‘“C;éi‘éi‘;*;é‘«CS™S 
PeerGroup 26% 4 22 74 


Abbreviations: CBT = cognitive behavioral therapy; Fam = family therapy; ICM = intensive case management; MI = 
motivational interviewing; SUCRA = surface area under the cumulative ranking curve; TAU = treatment as usual 


Illicit Drug Use Outcomes 

Five studies with 1,310 participants!!? 174181, 19, 206, 207, 210 renorted illicit drug use days, 
and two studies with 281 participants'**-*° reported a scale reflecting illicit drug use. These 
compare interventions as shown in Figure 25. 


Figure 25. Evidence graph for studies reporting illicit drug use days 


C) PeerGroup 


ICM CBT 


MI 


Abbreviations: Fam = family; CM = contingency management; TAU = treatment as usual; CBT = cognitive behavioral 
therapy; ICM = intensive case management; MI = motivational interviewing; Educ = education. 
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Key Question 1: Illicit Drug Use Days — Interventions Compared to TAU 

CBT+MI resulted in a net decrease in overall illicit drug use days, compared to TAU. We 
rated the associated SoE as low. 

The effects for CBT, ICM and MI were imprecisely estimated, as illustrated in Figure 26. 
This network is also very sparse and loosely connected, and because most RCTs are small, 
the statistical power to detect inconsistency between direct and indirect effects is very 
limited. Estimates of treatment effectiveness are very imprecise. 


Figure 26. Illicit drug use days: Summary forest plot of interventions reporting meta-analyzed 
illicit drug use days compared to TAU 


Intervention NMD [95% Cr] 


CBT | 1.5 [-7.7, 5.5] 
CBT+MI ee: -3.0 [-5.1, -1.0] 
Fam -e: “1:1 [-2.5, 0.1] 
ICM : 1.7 [ -9.5, 6.4] 
MI 6.3 [-14.1, 1.5] 


T ] ] ] 
-16.0 -100 -40 20 8.0 
Net Mean Difference (days/mo.) vs. TAU 


Abbreviations: Fam = family; CM = contingency management; TAU = treatment as usual; CBT = cognitive behavioral 
therapy; ICM = intensive case management; MI = motivational interviewing; Educ = education. 


Key Question 2: Illicit Drug Use Days — Comparative Effects 

None of the active interventions or combined interventions were different from each other 
(Table 18). We rated the associated SoE as insufficient. 

Most of the results in the Table are based on indirect data, with direct data limited to only 
one or two studies. The statistical power to detect inconsistency between direct and indirect 
effects is very limited. Thus, estimates of treatment effectiveness are very imprecise. 

As shown in Table 19, MI was most likely to rank in the top third. TAU had a 75 percent 
probability of ranking in the bottom third. 


a2 


Table 18. Nonbrief behavioral interventions and illicit drug use: Net mean difference of use 
days per month between all interventions 


Intervention(s) CBT CBT+MI Fam ICM MI TAU 
CBT CBT 16 0.3 -0.2 4.9 1.5 
(-8.8, 5.1)  (-6.5, 6.5) (-4.8, 4) (-9.5, -0.4) (-5.5, 7.7) 
CBT+MI 1.6 CBT+MI 1.9 1.3 -3.2 3 
(-5.1, 8.8) (-0.5, 4.2) (-6.7, 9.6) (-11.3, 4.7) (1, 5.1) 
Fam -0.3 -19 Fam -0.6 -5.1 1.1 
(-6.5, 6.5) (-4.2, 0.5) (-8.3, 7.4) (-12.8, 2.5) (-0.1, 2.5) 
ICM 0.2 13 06 ICM -4.6 1.7 
(-4, 4.8) (-9.6, 6.7) (-7.4, 8.3) (-9, -0.2) (-6.4, 9.5) 
MI 49 3.2 5.1 46 MI 6.3 
(0.4, 9.5) (-4.7,11.3)  (-2.5, 12.8) (0.2, 9) (-1.5, 14.1) 
TAU 1.5 3 -1.1 “1.7 -6.3 TAU 


(-7.7, 5.5) (-54,-1) (25,01) (95,64) (14.1, 1.5) 
Bold font indicates statistical significance. 


Abbreviations: CBT = cognitive behavioral therapy; Fam = family therapy; ICM = intensive case management; MI = 
motivational interviewing; TAU = treatment as usual 


Table 19. Probabilities of nonbrief behavioral interventions ranking in top third, middle third 
and bottom third to reduce illicit drug use days 


Intervention(s) | SUCRA  TopThird Middle Third seo 
mM ””~«SBMHSC“‘C‘“‘(‘é‘SCO*“‘C‘ Q]W™;CS*~‘(‘“*;! 
“CBM tC(“‘iw&#®OO!”;*«‘“_ ||]!!! 
ICM 53% 30 31 39 
“Fan t—i“‘<‘ésOO!O!O!OU€UOUUO!O!O!}!}OUUU!!!C 
“CBT (t;w”~”~CHO~<s<‘<‘ H*C‘“‘ C;*;*;<‘ SS 
‘TUUt~<“‘<‘iHS:*~<“‘<‘i ;”;*;*‘“(Ciét®‘:;*«SSCS 


Bold font indicates the highest probability of ranking in top third and bottom third respectively. 


Abbreviations: CBT = cognitive behavioral therapy; Fam = family therapy; ICM = intensive case management; MI = 
motivational interviewing; SUCRA = surface area under the cumulative ranking curve; TAU = treatment as usual 


Other Outcomes 
Other outcomes were sparsely reported. The outcomes, number of studies reporting the 
outcome and number of participants are summarized in Table 20 below. 
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Table 20. Other outcome participant summaries 


Outcome No. Studies No. Participants 
School Performance and Educational Attainment 5113, 141, 143, 154, 187 353 
5141, 143, 154, 
174, 185 
Family Related 709 
Peer Related 3141, 143, 154 200 
Mental Health Events 2121, 146 184 
Physical Health Events 2121, 184 194 
10113, 119, 121, 130, 
135, 139, 141, 143, 187, 
Legal Outcomes* ae 1620 


*Legal outcomes include arrests and convictions, self-reported general delinquency/illegal behavior, self-reported crimes 
against persons and property crimes/theft. 


These studies evaluated multiple interventions using a variety of outcome metrics. In 
general, estimated effects were imprecise with no clear trends across studies. Study-specific 
details are tabulated in Appendix G (Tables G-4 to G-8). 


Systematic Reviews of Treatments for Alcohol Use in the 
College Setting 


Key Points 


e 2SRs of the general population of college students who drink alcohol found that, on 
average, compared to no intervention, behavioral interventions resulted in reduced 
alcohol use for up to about 6 months, but these effects waned in the long term. 
However, behavioral interventions resulted in fewer alcohol-related problems over the 
medium to long term. One SR found that, by indirect comparison, face-to-face 
interventions provide larger and more enduring effects than computer-delivered 
interventions (SOE not assessed). 

e 2SRs focused on college students mandated to attend alcohol programs. On average, 
alcohol use decreased in the short- to medium-term regardless of intervention, but 
mostly did not persist. Four specific commercially available interventions were found 
to be more effective in the short term than others (SOE not assessed). 

e 2SRs focused on college students who engaged in heavy or hazardous alcohol use. 
Brief, single-session interventions and the commercially-available BASICS program 
were found to reduce alcohol use compared with no intervention. Among the brief 
behavioral interventions, MET/MI had the strongest effect (SOE not assessed). 


To evaluate treatment of alcohol use disorders/problematic alcohol use in the college 
setting, we summarized existing SRs only, since this literature is large, highly contextual, and 
has been extensively reviewed. The search for SRs addressing interventions for treating 
problematic alcohol use or alcohol use disorder in the college setting identified six SRs 
published between 2005 and 2015. These SRs included between 16 and 73 studies each 
(median 40). 

The SRs mostly meta-analyzed standardized effect sizes across multiple outcomes and 
interventions. This approach requires the strong (and unlikely) assumption that effects are 
homogeneous across disparate outcomes and interventions. In general these SRs did not 
adequately perform and report risk of bias assessments and did not discuss the consistency of 
results. Given these limitations, we have not make SoE assessments. 
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General Population of College Students Who Drink Alcohol 


Two SRs did not require any population-specific eligibility criteria for studies other than 
that the study participants be college students who consume alcohol.”!!?!? 

Carey 2007 reported a SR of 62 randomized controlled trials (RCTs), with 13,750 
participants that compared 98 separate individual-level behavioral interventions (usually 
multicomponent) with control interventions.7!! Studies included different subpopulations, 
such as heavy drinkers, moderate drinkers, and alcohol offenders. Effect sizes (standardized 
mean differences) were reported in the immediate term (<3 weeks), short term (4 to 13 
weeks), intermediate term (14 to 26 weeks), and long term (27 to 195 weeks) for various 
alcohol use measures and alcohol-related problem measures. The meta-analyses were deemed 
inadequate due to use of effect sizes comprised of disparate outcomes, inclusion of multiple 
effect sizes from individual studies, and exclusion of outlier results. 

The effect sizes for the alcohol use measures (e.g., alcohol use quantity, frequency of 
heavy drinking) generally favored the intervention groups until the intermediate term, ranging 
from 0.11 to 0.41 standard deviation (SD) units. However, these benefits did not persist in the 
long term; almost all effect sizes diminished over time. In the long term, the only persistent 
effect of the interventions on alcohol use was on frequency of drinking days (effect size=0.16 
SD units, 95% CI 0.03 to 0.30). 

A different pattern emerged for the alcohol-related problem measures (e.g., drinking and 
driving, property damage, fights). Although students in the intervention groups had fewer 
alcohol-related problems than those in the control groups, the beneficial effect of the 
interventions on alcohol-related problem measures took longer to emerge (no immediate 
effect, but short-term effect size=0.15 SD units, 95% CI 0.08 to 0.21), peaked in the 
intermediate term (effect size=0.22 SD units, 95% CI 0.12 to 0.32), and persisted in the long 
term (effect size=0.14 SD units, 95% CI 0.06 to 0.22).7!! 

In a subsequent SR, Carey 2012 primarily examined RCTs (47 RCTs, | nonrandomized 
comparative study [NRCS]), with 5,237 participants, that focused on the mode of delivery of 
behavioral interventions.”!* The SR compared face-to-face interventions and computer- 
delivered behavioral interventions with TAU or no intervention, and with each other. Carey 
2012 examined similar outcomes as Carey 2007 that were analyzed using the same effect size 
measurements at the same follow-up time-periods. The meta-analyses, thus, had similar 
issues as Carey 2007, except that outlier results were not omitted. 

Compared with TAU, students receiving face-to-face interventions drank less per week or 
month (effect sizes ranged from 0.15 to 0.19 SD units) and per drinking day (effect sizes 
ranged from 0.17 to 0.23 SD units), drank less frequently (effect sizes ranged from 0.07 to 
0.16 SD units), and reported fewer alcohol-related problems (effect sizes ranged from 0.09 to 
0.15 SD units) in the short and intermediate term. However, the only persistent effect of face- 
to-face interventions in the long term was on alcohol use per drinking day (effect size=0.16, 
95% CI 0.03 to 0.30 SD units). 

Comparing different active interventions, students in the computer-delivered 
interventions groups had similar benefits as face-to-face interventions in the short term (4 to 
13 weeks), but not in the intermediate or long term. Direct comparisons between face-to-face 
interventions and computer-delivered interventions were infrequent. In the short term, the 
two modes of delivery had similar effects on alcohol use and alcohol-related problems. 
However, face-to-face interventions were more effective in reducing peak blood alcohol 
concentration (BAC) in the intermediate term (weighted sum of squares of group mean effect 
size [Qp]=6.74, p=0.009) and frequency of heavy drinking in the long term (Qp=6.65, 
p=0.010). Overall, Carey 2012 concluded that face-to-face interventions provide the strongest 
and most enduring effects in this population.?!” 
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College Students Mandated To Receive Interventions for Alcohol 
Use 


Two SRs focused on studies of college students who were mandated to attend a program 
to reduce their alcohol consumption.”!*:?!4 

Carey 2016 included 31 studies (21 RCTs and 10 NRCSs), with 8,621 participants, that 
compared various group- or individual-level behavioral treatments. A single effect size was 
selected from each study for inclusion in meta-analysis, but the effect sizes were comprised 
of disparate outcomes. 

In the short term (i.e., <13 weeks), all alcohol use and alcohol-related problem measures 
improved (compared with baseline) in students, regardless of interventions (within-group 
effect sizes ranged from 0.14 to 0.27 SD units). In the medium term, improvements were 
observed in frequency of heavy drinking (effect size=0.14 SD units, 95% CI 0.04 to 0.23), 
peak BAC (effect size=0.25 SD units, 95% CI 0.14 to 0.36), typical BAC (effect size=0.17 
SD units, 95% CI 0.04 to 0.29), and alcohol-related problems (effect size=0.13 SD units, 
95% CI 0.06 to 0.21). However, the only within-group effect to persist in the long term was 
on typical BAC (effect size=0.12 SD units, 95% CI 0.01 to 0.25). 

Four commercially available intervention protocols (Brief Alcohol Screening and 
Intervention for College Students [BASICS], Electronic Check-Up To Go [e-CHUG], 
Alcohol 101, and Alcohol Skills Training Program) were shown to be most effective. Carey 
2016 reported between-group comparisons, based on short term followup, when one of these 
4 interventions was mandated. In the control group, participation in a mandated intervention 
was associated with lower number of drinks per week (between-group effect size=0.13 SD 
units, 95% CI 0.02 to 0.25), peak BAC (effect size=0.20 SD units, 95% CI 0.06 to 0.33), and 
typical BAC (effect size=0.16 SD units, 95% CI 0.01 to 0.31). Alcohol-related problems 
were similar between the two groups.7!4 

Barnett 2005 included 16 studies, but only three of these, all RCTs with a total of 213 
participants, were comparative in design.”!? Due to small numbers of similar studies, meta- 
analysis was not performed. The three trials randomized mandated college students to three 
pairs of brief behavioral interventions (MI vs. alcohol education, lifestyle management 
compared to no intervention, and videotaped expectancy challenge vs. alcohol education). 
Outcomes were similar and not statistically significant for the first two comparisons/studies, 
except that MI was more effective than alcohol education in improving alcohol-related 
problems (between-group effect size=0.39 SD units, p<0.05). For the third comparison/study, 
alcohol education was more effective than the alcohol expectancy challenge intervention in 
improving alcohol knowledge (effect size=—1.47 SD units, p<0.05)."3 


College Students Who Engaged in Heavy or Hazardous Levels of 
Alcohol Use 


Two SRs examined studies of college students who engaged in heavy or hazardous levels 
of alcohol use.?!>-?!° Both SRs focused on the comparison between brief behavioral 
interventions (one or two sessions) with no intervention or TAU. 

Samson 2015 included 73 studies (“experimental” or “controlled quasi-experimental” 
studies) that evaluated a single-session intervention (CBT, MET/MI, personalized feedback, 
or psychoeducation therapy [PET]).”!° The meta-analysis combined 662 disparate effect sizes 
from 73 individual studies. The total number of participants was not reported. 

Single-session interventions were found to have a modest effect on reducing alcohol 
consumption among heavy-drinking college students (effect size=0.18 SD units, 95% CI 0.12 
to 0.24). Among the various types of single-session interventions, MET/MI was found to 
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have the strongest effect. This suggests that single-session interventions that incorporate 
aspects of MET/MI are likely the most effective among the single-session interventions in 
this population.”!© 

Fachini 2012 included 18 RCTs, with a total of 6,233 participants, that compared 
BASICS with TAU or no intervention in students engaged in heavy episodic drinking.”!> The 
meta-analyses focused on specific outcomes, and were deemed to be adequate. Overall, 
BASICS lowered both alcohol consumption and negative consequences in college students. 
Compared with the control group, students who received BASICS had fewer drinks per week 
(mean difference = —1.50, 95% CI —3.24 to —0.29) and fewer alcohol-related problems 
measured using the Rutgers Alcohol Program Index (RAPI) (mean difference in score = 
—0.87, 95% CI -1.58 to —0.20). 


Risk of Bias 


Based on a modified AMSTAR 2 assessment (Table 21), the SRs mostly adhered to 
standard design and reporting elements (except for failure to report methods regarding 
screening citations and articles). Four of the five SRs that conducted meta-analyses were 
deemed to have used inappropriate methods, only one SR adequately evaluated the summary 
results based on risk of bias assessments, and only one study reported conflict of interest 
information (they reported none). The primary concern about the meta-analyses, was that SRs 
mostly combined standardized effect sizes comprised of disparate sets of outcomes and often 
included multiple effect sizes from individual studies. 
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n Arisk of bias score (range 0-17) was used, but not adequately described. 

o Multiple effect sizes within studies were averaged prior to meta-analysis. 

p Risk of bias assessment was unclear and possibly incomplete. 

q 662 effect sizes from 73 studies were included in a single meta-analysis. 

r Unclear, possibly incomplete, risk of bias assessment. 

s Asingle effect size was selected from each study for meta-analysis, but effect sizes pertained to disparate 
outcomes. 

t Meta-analyses were adjusted for risk of bias, but not analyzed based on risk of bias. 


Pharmaceutical Interventions 


We found only a small number of studies pharmacologic treatments (with or without 
combined behavioral interventions) for substance use disorder in adolescents. We found no 
large nonrandomized studies which evaluated medication side-effects in adolescents. 

In studies that combined pharmacologic and behavioral interventions, the behavioral 
interventions were often less completely described, and therefore not easily compared to the 
detailed manual based interventions typical in behavioral trials. Drug trials included placebo 
arms, which due to the likelihood of a placebo effect, were not deemed comparable to TAU 
arms in studies of behavioral interventions. Thus, we did not jointly synthesize studies of 
behavioral interventions with studies of pharmacologic interventions and summarize these 
studies separately by use disorder. 


Key Points 


e Opioid use disorder 
o Longer courses (2 to 3 months) of buprenorphine are more effective than shorter 
courses (14 to 28 days) to reduce opioid use and achieve abstinence (low SoE) 

=  Buprenorphine-naloxone (12-week versus 2-week) is more effective in 
reducing opioid use at 9 and 12 months (1 study) 

= Buprenorphine+CBT+CM was more effective than 
clonidine+CBT+CM in increasing odds of opioid abstinence at 1 
month (1 study) 


Opioid Use Disorder 


Four comparative studies (in 13 publications*!”**’) published between 2005 and 2016 
assessed pharmacologic or combination pharmacologic and behavioral interventions to 
reduce opioid use in a total of 330 adolescents, all of whom had SUD. Participants in the 
studies were on average 17 to 23 years of age (range across studies 14 to 25 years). Baseline 
and arm details are given in Table 22. Risk of Bias summaries are given in Figure 27. 


Table 22. Baseline data and Interventions: Pharmacologic interventions for opioid use 


Author, Year N Substances Severity Ages Male Setting Intervention Arm Names 
Used [Eligible] % Delivery 
Mean 
(SD) 
Gonzalez, 20152"9. 229 87 opioid SUD [18, 25] 66 outpatient research staff 1. Buprenorphine- 
cannabis 22.6 (1.9) research clinic (PhD Naloxone+Placebo+CBT 


psychologist) (group): “Placebo” 


2. Buprenorphine- 
Naloxone+Memantine30+CBT 
(group): “Memantine 30” 


3. Buprenorphine- 


Naloxone+Memantine15+CBT 
(group): “Memantine 15” 
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Author, Year N Substances Severity Ages Male Setting Intervention Arm Names 


Used [Eligible] % Delivery 
Mean 
(SD) 
Marsch, 200522": 224 36 opioid SUD [13, 18] 50 outpatient no detail (drug 1. Clonidine+CBT+CM: 
cannabis 17.3 (0.7) research clinic _ trial) “Clonidine” 
alcohol 
cocaine 2. Buprenorphine+CBT+CM: 
amphetamine “Buprenorphine” 
Marsch, 2016222 53 opioid SUD [16, 24] 54 outpatient no detail (drug 1. Buprenorphine+Placebo+ 
alcohol 21 (2.5) research clinic _ trial) CBT+MI+Educ+ 
cocaine Fam|[systems/structural]+CM: 
cannabis “Buprenorphine 28-day taper” 


amphetamine 
2. Buprenorphine+CBT+MI+ 
Educ+Fam|[systems/structural]+ 
CM: “Buprenorphine 56-day 


taper” 
Woody, 2008217; 218, 220, 154 opioid SUD (14, 21] nr outpatient no detail (drug 1. Buprenorphine+Naloxone- 
223, 225-228 cannabis nr community trial) short+TAU (group): “Short-term 
alcohol buprenorphine-naloxone” 
cocaine 
injection drugs 2. Buprenorphine+Naloxone- 
extended+TAU (group): 
“Extended buprenorphine- 
naloxone” 


Abbreviations: CBT = cognitive behavioral therapy; CM = contingency management; ED = emergency department; Educ = 
psychoeducation; Fam = Family therapy; MI = motivational interviewing; N=number randomized; nr = not reported; SD = 
standard deviation; SUD = substance use disorder; TAU = treatment as usual 


Arm names = Intervention codes, (intervention modifiers) and [family subclassification]: "study arm name". 


Except for Woody 2008, the studies were double blinded. However, studies mostly had 
high attrition rates and poor compliance, reflecting the challenges of engaging this 
population. 


Figure 27. Pharmacologic intervention studies for opioid use: Percentage of studies in each 
risk of bias category 
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@Lowrisk ofbias Unclear risk of bias mHigh risk of bias 
As shown in Table 23, all four studies assessed buprenorphine-naloxone or buprenorphine 
alone or combined with behavioral interventions. Comparisons were between doses or 
tapering schedules, with clonidine, or with memantine. 
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Woody et al. 2008 reported that adolescents in the extended 12-week buprenorphine- 
naloxone arm were more likely to report no opioid use in the last month at 9 and 12 months 
than adolescents in the short term (2 week) buprenorphine-naloxone group, but not at 6 
months. Additionally, they report an overall group-by-time interaction odds ratio for any 
opioid use of 1.34 (95% CI 0.70 to 2.57), favoring the extended 12-week buprenorphine- 
naloxone -artn.22 218» 220: 223, 225-228 

Woody et al. 2008 reported no serious adverse events and no loss to follow-up due to 
adverse events. Adverse events reported were nausea, insomnia, stomach ache, vomiting, and 
anxiety.7!7 218; 220, 223, 225-228 A secondary analysis found that overall in the sample, those in the 
buprenorphine arm had a statistically significant decrease in injection drug use compared to 
the detox arm although there was a decrease in both groups.?”**”5 

Marsch et al. 2016 found that among those treated with buprenorphine (in combination 
with other behavioral interventions), opioid abstinence was higher in the 56-day taper group 
than in the 28-day taper group (OR 2.59, 95% CI 0.73 to 9.18).””* They reported that there 
were no serious adverse events related to treatment in either arm. 

Marsch et al. 2005 found that buprenorphine (combined with CBT + CM) performed 
better for abstinence than clonidine (combined with CBT + CM) (OR 4.00, 95% CI 1.00 to 
16.0), although the confidence interval was very wide. HIV risk behavior did not differ 
between the groups. No information was given on adverse events.7”!**4 A secondary analysis 
focused on emotional and behavioral outcomes found that among youth who were retained in 
treatment, there were significant reductions in two grouping scales (internalizing problems 
and total problems) and four syndrome scales (somatic, social, attention, and thought”). Of 
note, there were more youth retained in the buprenorphine arm retained (n=13) compared to 
the clonidine arm (n=7). 

Gonzales et al. 2015 evaluated buprenorphine-naloxone plus memantine (either 15 mg or 
30 mg) or buprenorphine-naloxone plus placebo in 80 18- to 25-year-old young adults. Each 
arm also received weekly CBT delivered in a group format. They reported that for abstinence 
at 3 months, the arm with buprenorphine-naloxone plus 30 mg of memantine performed 
much better than the 15 mg arm (OR 9.2, 95% CI 2.62 to 32.28) or the placebo arm (OR 9.2, 
95% CI 2.69 to 31.46), and the 15 mg arm performed slightly worse than placebo (OR 0.78, 
95% CI 0.27 to 2.31). The same general pattern held for opioid use frequency, though the 
confidence intervals were wide for both abstinence and use outcomes and the 15 mg arm had 
a lower use frequency than placebo. Reported adverse events included pain, drowsiness, vivid 
dreams, constipation, upper respiratory infection, nausea, and headaches. Any adverse event 
was reported in 39 and 30 percent of the memantine 30 mg and 15 mg arms, respectively, as 
compared to 49 percent of the placebo arms, and there were no serious adverse events.”!” 
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Alcohol Use Disorder 


Seven comparative studies published between 2003 and 2016 assessed pharmaceutical 
interventions to reduce alcohol?*°*? use in 543 adolescents, total. Participants in the studies 
were on average 16 to 21 years of age (range across studies 13 to 21). Baseline and intervention 
details are given in Table 24. 

Five of the seven studies were placebo-controlled evaluations of a single pharmaceutical 
agent (disulfiram, cyanamide or naltrexone). Two studies compared disulfiram to naltrexone. In 
addition to a medication, four of the seven studies included a behavioral intervention in both 
arms (e.g., education, MI, or CM). 

Table 24. Baseline data and interventions: Pharmacologic treatments of alcohol use 


“Author, Year N Substances Severity Ages/[Eligible] Male Setting Intervention Arm Names 
Used Mean (SD) % Delivery 
Miranda, 2014232 22 alcohol PU [15, 19] 36 outpatient no detail (drug 1. Placebo: “Placebo” 
cannabis 18 (1.2) research clinic _ trial) 
2. Naltrexone: “Naltrexone” 
Niederhofer, 200323. 26 alcohol SUD [16, 19] 38 hospital no detail (drug 1. Placebo: “Placebo” 
17.1 (0.9) trial) 
2. Cyanamide: “Cyanamide” 
Niederhofer, 2003755 49 alcohol SUD [16, 19] 69 hospital no detail (drug 1. Placebo: “Placebo” 
16.9 (0.3) trial) 
2. Disulfiram: “Disulfiram” 
Niederhofer, 2003253. 26 alcohol SUD [16, 19] nr 1. Placebo: “Placebo” 
nr 
2. Naltrexone: “Naltrexone” 
O'Malley, 2015286289 140 alcohol PU [18, 25] 69 outpatient therapists and 1. Placebo+MI: “Placebo+MI” 
cannabis 21.5 (2.1) research clinic nurse 
practitioner 2. Naltrexone+MI: 
(no detail) “Naltrexone+MI” 
De Sousa, 2008280 58 alcohol SUD [15, 18] nr outpatient no detail (drug 1. Naltrexone+Educ (group): 
17.3 (nr) psychiatric trial) “Naltrexone” 
center 
2. Disulfiram+Educ (group): 
“Disulfiram” 
De Sousa, 201423" 52 alcohol SUD [15, 18] nr outpatient no detail (drug 1. Naltrexone+Educ (group): 
17.3 (nr) psychiatric trial) “Naltrexone” 
center 


2. Disulfiram+Educ (group): 
“Disulfiram” 


Arm names = Intervention codes, (intervention modifiers) and [family subclassification]: "study arm name". 


Abbreviations: Educ = psychoeducation; group = at least one component of the intervention was delivered in a group setting; MI 
= motivational interviewing; N=number randomized; nr = not reported; PU = problematic use; SD = standard deviation; SUD = 
substance use disorder 


Risk of bias summaries are given in Figure 28. With the exception of de Sousa 2008,”°°*! 
the studies were double blinded. Most studies did not conduct intention-to-treat analyses. 


64 


Figure 28. Pharmacologic Interventions for alcohol use: Percentage of studies in each risk of bias 
category 
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The reported outcomes included mean days of substance use, heavy use, abstinence, 
consequences, and adverse events. Results for each outcome are given in Table 25. 

The six studies that reported on use outcomes in alcohol users reported that active 
interventions performed better than placebo for abstinence, use days, heavy drinking, or 
consequence scores in alcohol?*”*3 35-73 or cannabis.732 4°44 Two studies compared 
naltrexone to placebo, and one study compared naltrexone and MI to placebo and MI. 
Niederhofer 2003 found naltrexone performed better than placebo for increasing days abstinent 
(mean difference 47.0, 95% CI 36.6 to 57.4) and abstinence overall (OR 4.00, 95% CI 1.37 to 
11.7) at 3 months Similarly, Miranda 2014 found naltrexone performed better than placebo in 
reducing alcohol use days (mean difference —0.70, 95% CI —2.13 to 0.73) and heavy drinking 
days (mean difference —0.50, 95% CI —1.69 to 0.69) at 3 months, although the latter findings 
were not significant. When MI was combined with naltrexone and placebo, O’ Malley 2015 
observed similar results in favor of naltrexone for percent heavy drinking days, percent days 
abstinent, and alcohol consequences, however results were not significant (net mean difference 
—2.20, 95% CI —7.43 to 3.03; net mean difference 0.30, 95% CI —6.35 to 6.95; net mean 
difference —0.90, 95% CI-2.45 to 0.65, respectively) at 2 months Two studies by Niederhofer 
2003 found disulfiram and cyanamide performed better than placebo for abstinence (disulfiram: 
OR 6.42, 95% CI 1.00 to 41.2; cyanamide: OR 6.42, 95% CI 1.00 to 41.2) and days abstinent 
(disulfiram: mean difference 38.8, 95% CI 16.0 to 61.7; cyanamide mean difference 43.8 95% CI 
26.3 to 61.3) at 3 months. Finally, De Sousa 2008 found that disulfiram and education performed 
better than naltrexone and education for abstinence (OR 3.37, 95% CI 1.10 to 10.3).° 3! Across 
studies, adverse events were rarely reported, and where they were they were generally mild, 
including nausea, headache, and similar events. One study (O'Malley 2015) reported that there 
were no serious adverse events with either naltrexone or placebo; a second study (Miranda 2014) 
reported that there were two adverse events that lead to study discontinuation in the naltrexone 
arm (gastrointestinal symptoms) and none in the placebo arm.”*” 
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Cannabis Use 


We found two studies that enrolled 182 subjects (Table 26). Treatment with N-acetylcysteine 
did not result in over decreases in cannabis use days or cannabis abstinence. Risk of bias 
information is given in Figure 29. Treatment with topiramate+MI decreased cannabis use days, 
but not cannabis abstinence, compared to placebo+MI. However, treatment with Topiramate was 
associated with a higher odds of adverse events leading to withdrawal from treatment (Table 27). 


Table 26. Baseline data and interventions: Pharmacologic treatments for cannabis 


Author, Year N Substances _ Severity Ages Male Setting Intervention § Arm Names 
Used [Eligible] % Delivery 
Mean 
(SD) 
Gray, 2012241-244 116 cannabis SUD (13, 21] 72 outpatient physician, 1. Placebo+CM: “Placebo” 
18.9 (1.5) research clinic — physician 
assistant 2. N-acetylcysteine+CM: 
“N- acetylcysteine” 
Miranda, 201724 66 cannabis PU [15, 24] 46 outpatient research staff 1. Topiramate+MI: 
a 18.8 (2.1) research clinic (graduate “Topiramate” 
students) 


2. Placebot+MI: “Placebo” 


Arm names = Intervention codes, (intervention modifiers) and [family subclassification]: "study arm name". 


Abbreviations: CM = contingency management; N=number randomized; PU = problematic use; SD = standard deviation; SUD = 
substance use disorder 


Figure 29. Pharmacologic interventions for cannabis use disorder: Percentage of studies in each 
risk of bias category 
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Table 27. Results: Pharmacologic treatments for cannabis use 


Study Arm 1 Arm 2 Outcome Time Arm 1 Arm 1 Arm 2 Arm2 Calculated Effect 
Author, (mo) N Events (%) N Events (%) (95% Cl) 
Year, PMID 
Miranda, Topiramate + MI Placebo _— Abstinent from 1 40 12 (30) 26 4 OR 2.4 
2016, 24°. +Ml cannabis (n, %) (16) (0.7, 8.3) 
245 
Abstinent from 15 40 8 (20) 26 4 (16) OR 1.38 
cannabis (n, %) (0.4, 5.1) 
Cannabis use 1 40 53 (46, 59) 26 56 Diff -3.0 
days (%, 95% (48, 63) (-12.1, 6.2) 
Cl) 
Cannabis use 15 40 41 (34, 47) 26 56 Diff -15.0 
days (47, 63) (-24.1, -5.9) 
(%, 95% Cl) 
Serious 1 40 0 (0) 26 0 (0) No events 
adverse events 
n(%) 
Adverse events 1 40 14 (35) 26 1 (4) OR 13.5 
leading to (1.6, 110) 
withdrawal n 
(%) 
Gray, 2012, N-acetylcysteine Placebo = Abstinent from 2 58 11 (19) 58 6 (10.3) OR 2.4 
ee) +CM +CM cannabis (n, %) (0.8, 7.5) 
Cannabis use 2 58 41.1 (4.3) 58 37.0 (4.4) Diff -4.0 
days (% (-15.8, 7.9) 
decrease) 
Serious 2 58 0 (0) 58 0 (0) No events 
adverse events 
n (%) 


Bold font indicates that the 95% CI does not contain | for ORs or 0 for differences. 


Abbreviations: CI = confidence interval; CM = contingency management; group = at least one component of the intervention was 
delivered in a group setting; MI = motivational interviewing; OR = odds ratio 


Comorbid Psychiatric Disorders in Adolescents With SUD 


Key Points 


e Instudies of combined pharmacological and behavioral treatments for ADHD, bipolar 
disorder and depression for adolescents with SUD, the various interventions did not have 
consistent effects on the severity of the target psychiatric disorder. 

e No study found significant increases or decreases in substance use outcomes. However, 
substance use outcomes were imprecisely estimated. 


Specific Psychiatric Comorbidities 


We found 10 RCTs that described treatments for specific psychiatric comorbidities in 
adolescents with a concurrent substance use disorder.*“°?® Studies were included if they reported 
the effects of pharmacologic treatment (with or without integrated behavioral interventions) on 
the severity of the comorbid mental health disorder and at least one substance use outcome. Given 
that substance use outcomes may depend on successful treatment of the psychiatric disorder, we 
have summarized both psychiatric and substance use outcomes. 

Sample size per study ranged from 34 to 303 participants. The studies enrolled patients with 
one of four psychiatric diagnoses: Attention-deficit/hyperactivity disorder (ADHD; 3 studies 
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total; 1 with associated conduct disorder), depression (4 studies) and bipolar disorder (3 studies) 
who had concurrent substance use disorders for alcohol and/or cannabis, or other unspecified 
substances. Many adolescents in all studies used multiple substances, most commonly alcohol and 
cannabis and reported use of opioids, stimulants, sedatives, hallucinogens, and inhalants less 
commonly (<10% of participants). 
Baseline and arm details are given in Table 28. Risk of bias summaries are given in Figure 30. 


Table 28. Baseline data and interventions: Pharmacologic interventions for psychiatric 


comorbidities in adolescents with substance use disorders 
Substances 


Comorbidity Author, Year 


ADHD Riggs, 2011252: 255. 


257-259, 262, 263 


ADHD Thurstone, 20102°° 


ADHD, Riggs, 2004764 
conduct 
disorder 


bipolar Delbelo, 20177>5 
disorder 


bipolar Geller, 19987°! 
disorder 


bipolar Delbelo, 2017754 
disorder ina 

current 

manic or 

mixed 

episode 


depression Cornelius, 2009747 


N 


303 


70 


69 


39 


25 


rhs) 


50 


Used 


cannabis 
alcohol 
other drugs 


cannabis 
alcohol 
other drugs 


cannabis 
alcohol 
other drugs 


alcohol 


cannabis 
alcohol 
other drugs 


cannabis 


alcohol 


Severity Ages 


SUD 


SUD 


SUD 


SUD 


SUD 


PU 


SUD 


[Eligible] 
Mean 
(SD) 


[13, 18] 
16.5 (1.3) 


(13, 19] 
16.1 (1.8) 


(13, 19] 
15.8 (1.4) 


(12, 25] 
18 (3.1) 


[12, 18] 
16.3 (1.2) 


(12, 18] 
17.4 (0.2) 


[15, 20] 
nr 


69 


Male 
% 


79 


79 


83 


38 


64 


49 


44 


Setting 


outpatient 


outpatient 
(medications 
prepared by 
research 
pharmacist) 


outpatient 
research 
clinic 


outpatient 


outpatient 


outpatient 
research 
clinic 


Arm Names 


1. Placebo+CBT+MI 
(integrated): “Placebo + CBT” 


2. Methylphenidate+CBT+MI 
(integrated): “Osmotic-release 
methylphenidate + CBT” 


1. Placebo+CBT+Ml 
(integrated): “Placebo + 
CBT/MI” 


2. Atomoxetine+CBT+MI 
(integrated): “Atomoxetine + 
CBT/MI” 


1. Placebo (integrated): 
“Placebo” 


2. Pemoline (integrated): 
“Pemoline” 


1. Quetiapinet+Topiramate 
(integrated): 
“Quetiapine+Topiramate” 


2. Quetiapine+Placebo 
(integrated): 
“Quetiapine+Placebo” 


1. Placebo (integrated): 
“Placebo” 


2. Lithium (integrated): “Active” 
1. Quetiapine+Topiramate 
(integrated): 
“Quetiapine+topiramate” 


2. Quetiapine+Placebo 
(integrated): 
“Quetiapine+placebo” 
1. Placebo+CBT+Ml 
(integrated): “Placebo” 


2. Fluoxetine+CBT+MI 
(integrated): “Fluoxetine” 


Comorbidity Author, Year N Substances Severity Ages Male Setting Arm Names 
Used [Eligible] % 
Mean 
(SD) 
depression Cornelius, 201074 = 70 cannabis SUD [14, 25] 61 outpatient 1. Placebo+CBT+Ml 
28), 209 alcohol 21.1 (2.4) research (integrated): “Placebo” 
clinic 
2. Fluoxetine+CBT+MI 
(integrated): “Fluoxetine” 
depression Findling, 20097°° 34 cannabis SUD [12, 17] 85 outpatient 1. Placebo (integrated): 
alcohol 16.5 (1.1) research “Placebo” 
Clinic 
2. Fluoxetine (integrated): 
“Fluoxetine” 
depression Riggs, 20077 6! 126 cannabis SUD [13, 19] 67 outpatient 1. Placebo+CBT: “Placebo + 
alcohol 17.2 (1.7) research CBT” 


other drugs clinic 
2. Fluoxetine+CBT: “Fluoxetine 
+ CBT” 


Arm names = Intervention codes, (intervention modifiers) and [family subclassification]: "study arm name". 


Abbreviations: ADHD = attention-deficit/hyperactivity disorder; CBT = cognitive behavioral therapy; integrated = intervention as 
a whole was designed to treat substance use disorder/problematic use and at least one other diagnosis (e.g., mental health); MI = 
motivational interviewing; N=number randomized; nr = not reported; PU = problematic use; SD = standard deviation; SUD = 
substance use disorder 


The most commonly observed risk of bias concerns related to incomplete outcome data, group 
similarity at baseline and compliance (Figure 30). 


Figure 30. Pharmacologic interventions for psychiatric comorbidities in adolescents with 
substance use disorders: Percentage of studies in each risk of bias category 
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The reported outcomes included severity of comorbidity condition, mean days of substance 
use, heavy use, abstinence, consequences, and adverse events. Full results for each outcome in 
studies treated for co-existing ADHD, depression, and bipolar disorder are given in Tables 29, 30, 
and 31, respectively. 


The three studies that reported on outcomes in not otherwise specified substance abuse 
populations with comorbid ADHD found no impact of pharmacologic agents pemoline, 
atomoxetine, or fluoxetine (with or without behavioral interventions) on ADHD symptoms, use 
days, or adverse events. 

Four studies that reported on outcomes in populations defined by alcohol, cannabis, or not 
otherwise specified substance abuse populations with comorbid depression. Three studies found 
no impact of fluoxetine (with or without CBT + MI) on symptoms of depression, use days, 
problem scores (e.g., abuse symptoms and dependence symptoms). The exception is Riggs et al., 
2007.**° This study enrolled patients with substance use and depression and compared fluoxetine 
+ MI+CBT, with placebo+MI+CBT. They found a net mean difference of —4.2 (95% CI —9.7, 
—2.0) suggesting an improvement in depression symptoms as measured by the Children’s 
Depression Rate Scale, Revised (CDRS-R). 

The three studies that reported outcomes in populations defined by alcohol and cannabis use 
with comorbid bipolar disorder found no impact of lithium or quetiapine + topiramate on 
symptoms of mental health and of adverse events observed, most either occurred rarely, or where 
presented, were comparable between groups. 


Table 29. Results: Pharmacologic interventions for ADHD in adolescents with substance use 
disorders 


Study Arm 1 Arm 2 Outcome Time (mo) Arm Arm-1— Arm- Arm-2 Effect 
Author, 1N Outcome 2N Outcome (95% 
Year, PMID 
Riggs, Pemoline Placebo CHIS 4 34 -12.2 34 -7.2 
2004 264 (-18.5, (-12.0, -5.0 
-5.9) -24)  (-12.9, 
Riggs, Methylphenidate Placebo+ ADHD-RS 4 1514 -19.2 152 -21.2 MD2.0 
2011 +CBT +MI CBT + MI (-21.2, (-23.2 (-0.9, 
252, 255, 257- -17.2) -19.2) 
259, 262, 263 
Uses days (past 4 1514 -5.7 152 -5.2MD-0. 
28 days non- (-7.2, (-6.8, 
tobacco) -4.1) -3.6) (-2.7 
Thurstone, Ato+CBT+Ml Placebo + ADE - Vomiting 3 32 16 33 7 OR3.7 
2010 260 + Fam CBT +MI = (%) (1.3, 
+ Fam 11.0) 
ADE - 3 32 16 33 14 OR14 
Drowsiness (%) (0.51, 
ADE - Dif staying 3 32 16 33 20 OR0O.6 
asleep (%) (0.4, 
ADE - 3 32 18 33 15 OR1.5 
Abdominal Pain (0.6, 
(%) . 
ADE - Nasal 3 32 19 33 17 OR14 
Congestion (%) (0.5, 
ADE - Difficulty 3 32 19 33 23 OR0O.6 
falling asleep (%) (0.2, 
ADE - Appetite 3 32 19 33 12 OR26 
decrease (%) (0.4, 
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Study Arm 1 Arm 2 Outcome Time (mo) Arm Arm-1— Arm- Arm-2 Effect 
Author, 1N Outcome 2N Outcome (95% 
Year, PMID Cl) 
ADE - Difficulty 3 32 21 33 15 OR23 

concentrating (%) (0.4, 

6.2) 


Bold font indicates that the 95% Cl does not contain 1 for ORs or 0 for differences. 


Abbreviations: ADE = adverse event; ADHD-RS = Attention-Deficit/Hyperactivity Disorder Rating Scale; Ato = 
Atomoxetine; CBT = cognitive behavioral therapy; CHIS = Conners Hyperactivity-Ilmpulsivity scale (parent related); Cl 
= confidence interval; Fam = family based therapy; MD = mean difference; MI = motivational interviewing; N = number 


of participants analyzed; OR = odds ratio 
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Table 30. Results: Pharmacologic interventions for depression in adolescents with substance use 


disorders 
Study Author, Year, Arm 1 Arm 2 Outcome Time Arm1 Arm1 Arm Arm2Outcome _ Effect (95% Cl) 
PMID (mo) N Outcome 2N 
Cornelius Fluoxetine Placebo Depression 3 24 MD 26 MD -11.7 NMD 1.2 
2009 +CBT + + (BDI) -10.46 (-15.3, -8.0) (-3.8, 6.2) 
al MI CBT + (-13.8, 
MI -7.1) 
Problems 3 24. MD-2.66 26 MD -2.5 NMD -0.1 
(alcohol (-3.5, (-3.6,-1.5) (-1.5,1.2) 
SXS -1.8 
Cornelius, 2010 246 249, 265 Fluoxetine Placebo Use days 3 34 MD-0.03 36 MD -0.12 NMD 0.09 
+ CBT + + (heavy (-0.3, 0.3) (-0.4, 0.2) (-0.4,0.5) 
Ml CBT + drinking 
Ml days/wk) 
Problems 3 34 MD -0.1 36 MD -0.19 NMD 0.11 
(alcohol (-0.3, 0.1) (-0.4, 0.01) (-0.2, 0.4 
abuse sxs) 
Problems 3 MD -0.6 MD -0.25 NMD 
(dep sxs) (-1.1, (-0.7, 0.2) -0.3 (-1.0, 0.3) 
-0.1) 
Use days 3 34 MD -0.7 36 MD -1.2 NMD 0.5 
(per week) (-1.54, (-1.9,-0.6) (-0.6, 1.6) 
0.08) 
Problems 3 34 MD -0.8 36 MD -0.7 NMD -0.04 
(abuse sxs) 1A, (-1.0, -0.5) (-0.4,0.4) 
-0.4) 
Problems 3 34. MD-1.59 36 MD -2.0 NMD 0.5 
(dep sxs) (-2.2, (-2.6,-1.5) (-0.4, 1.3) 
-1.0) 
Riggs Fluoxetine Placebo Depression 4 63 MD-24.8 63 MD -18.9 NMD -5.9 
2007 +CBT + + CDRS-R (-27.5, (-21.6, -16.2) (-9.7, -2.0) 
256, 261 MI CBT + -22.0) 
MI 
AOD use 4 63 MD -3.94 63 MD -4.7 NMD 0.8 
days (-6.8, (-7.6, -1.8) (-3.3, 4.8) 
(per month) -1.1) 
Findling Fluoxetine Placebo Depression 2 18 MD-184 16 MD -22.6 NMD 4.2 
2009 CDRS-R (-19.7, (-24.1, -21.1) (2.2, 6.2) 
250 -17.1) 
AOD 2 12 8 13 10 OR 0.6 
abstinence (0.1, 3.5) 


Bold font indicates that the 95% CI does not contain | for ORs or 0 for differences. 


Abbreviations: AOD = alcohol and other drugs; BDI = Beck Depression Inventory; CBT = cognitive behavioral therapy; CDRS-R 


= Children’s Depression Rating Scale-Revised; CI = confidence interval; dep = dependence; MD = mean difference; MI = 


motivational interviewing; N = number of participants analyzed; NMD = net mean difference; OR = odds ratio; sxs = symptoms 
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Table 31. Results: Pharmacologic interventions for bipolar disorder in adolescents with substance 
use disorders 


Study Arm 1 Arm 2 Outcome Time Arm1 Arm1 9 Arm Arm2 OR 
Author, Year, (mo) N No. 2N No. (95% 
PMID events Events Cl) 
Geller, 1998 Lithium Placebo CGAS >=65 1.5 13 6 12 1 9.4 
251 (%) (0.9, 
95.9) 

Delbelo 2017  § Quetiapine/Topiramate  Quetiapine ADE - 4 18 2 21 8 0.2 
253 +Placebo — Suicidal (0.04, 
Ideation (N) 1.1) 

ADE - 4 18 0 21 1 0.6 

Suicidal (0.02, 

attempt (N) 18.1) 

ADE - 4 18 11 21 4 6.7 

Sedation (N) (1.6, 

28.3) 

ADE - Dif 4 18 9 21 3 6.0 

Arousing (N) (1.3, 

27.8) 

Delbelo 2017 Quetiapine/Topiramate  Quetiapine © ADE- Dry 4 38 23 37 30 0.4 
254 + placebo mouth (N) (0.1, 
1.0) 

ADE- 4 38 5 37 0 11.1 

Excitement (N) (0.6, 

210.3) 

ADE-Dif 4 38 12 37 20 0.4 

Staying (0.2, 

Asleep (N) 1.0) 

ADE-Dif 4 38 12 37 20 0.4 

Falling Asleep (0.15, 

(N) 1.0) 

ADE- 4 38 0 37 1 0.5 

Pregnancy (N) (0.02, 

14.8) 

ADE- Suicidal 4 38 1 37 0 2.0 

Ideation (N) (0.06, 

60.6) 

ADE- 4 38 4 37 5 0.8 

Hospitalization (0.2, 

(N) 3.1) 

ADE- Any (N) 4 38 23 37 30 0.4 


Bold font indicates that the 95% CI does not contain | for ORs or 0 for difference. 


Abbreviations: ADE = adverse event; CGAS = Children’s Global Assessment Scale; CI = confidence interval; N = number of 
participants analyzed; OR = odds ratio 
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Discussion 


Key Findings 

Most studies of brief behavioral interventions evaluated motivational interviewing (MI) 
compared to treatment as usual (TAU). These studies enrolled adolescents who often had 
problematic use of both alcohol and cannabis. Some heterogeneity in effects between studies was 
found, but MI resulted in overall decreases in heavy alcohol use days (i.e., binge drinking), 
overall alcohol use days and may reduce all substance use related problems compared to TAU. 
However, brief MI does not reduce days of cannabis use compared to TAU. 

Longer term (i.e., “nonbrief’) behavioral interventions were diverse and often combined 
multiple intervention components. This diversity severely limited our ability to evaluate their 
efficacy compared to TAU and to each other. Nevertheless, our analyses did suggest that family- 
based therapies (Fam) may most effectively decrease alcohol use days, and may be more effective 
than ICM, CBT and MI in reducing days of alcohol use. We found no evidence of efficacy for 
any intervention in decreasing days of cannabis use. Indeed, summary estimates suggest that 
some interventions (CBT, CBT+MI, CBT+MI+CM and Educ) increase cannabis use relative to 
TAU. 

Both MI and CBT reduce days of alcohol and other drug use relative to TAU, with MI more 
effective than PeerGroup, CBT+MI, Fam, CBT+ICM, CBT+MI+ICM, CBT and ICM. Illicit drug 
use decreased for CBT+MI compared to TAU. 

Overall, our findings suggest that that effects may vary by substance for both brief and 
nonbrief interventions. However, these conclusions are based on separate analyses (of 
overlapping groups of studies) that are not directly comparable. 

Existing systematic reviews of the general population of college students who drink alcohol 
found that, on average, compared to no intervention, behavioral interventions resulted in reduced 
alcohol use for up to about 6 months, but these effects waned in the long term. However, 
behavioral interventions resulted in fewer alcohol-related problems over the medium to long term. 
One SR found that, by indirect comparison, face-to-face interventions provide larger and more 
enduring effects than computer-delivered interventions. Two SRs focused on college students 
who engaged in heavy or hazardous alcohol use. Brief, single-session interventions and the 
commercially available BASICS program were found to reduce alcohol use compared with no 
intervention. Among the brief behavioral interventions, MET/MI had the strongest effect. Two 
SRs focused on college students mandated to attend alcohol programs. On average, alcohol use 
decreased in the short- to medium-term regardless of intervention, but mostly did not persist. Four 
specific commercially available interventions were found to be more effective in the short term 
than others. 

For opioid use disorder, longer courses (2 to 3 months) of buprenorphine are more effective 
than shorter courses (14 to 28 days) to reduce opioid use and achieve abstinence. 

For alcohol and cannabis use disorder, evidence is insufficient regarding the effects of 
medications adding medications to treat substance use disorders. There is insufficient evidence 
relating to the effects of pharmacologic treatments used for the treatment of psychiatric 
comorbidities, depression, ADHD, and bipolar disorder in patients with concomitant substance 
use disorders. 

When assigning strength of evidence (SoE) we considered various concepts including whether 
the conclusions are based on direct (head-to-head) or indirect comparisons (for which there were 
no head-to-head comparisons) and whether the reported outcomes are direct (true) measures of 
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the outcome of interest. In the network meta-analyses we conducted related to nonbrief behavioral 
interventions, conclusions are based predominately on indirect evidence, with sparse direct 
evidence. Although there was some variability in the definitions of use days, abstinence and drug 
related problems, these were deemed to be sufficiently minor so as not to affect the overall 
directness. In contrast, for subpopulations and additional outcomes that were not meta-analyzed, 
conclusions were downgraded for being indirect if the outcomes were generally not well-defined 
and likely varied across studies. 

The strength of evidence (SoE) for each conclusion, presented in Table 32, is based on a 
qualitative combination of the summary risk of bias across all relevant studies, the consistency of 
the studies, the precision of the available estimates, and the directness of the evidence. 
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Findings in Relationship to What Is Already Known 


Brief Behavioral Interventions 


Our review of randomized controlled trials (RCTs) found that brief MI or motivation 
enhancement therapy (MET) reduces heavy alcohol use and overall alcohol use compared to 
TAU in adolescents with problematic alcohol use. Across brief behavioral interventions, we 
concluded that MI is more effective than TAU in reducing substance use associated problems. 
These findings are generally consistent with the recent systematic review with meta-analysis 
(SR/MA) of experimental and quasiexperimental studies by Tanner-Smith and Lipsey.” 
Combining across multiple related outcomes and different interventions using a standardized 
effect size metric, they conclude that adolescents ages 11 to 18 who received brief alcohol 
interventions had lower levels of self-reported alcohol consumption and alcohol-related 
problems, and concluded that MI/MET strategies were most effective.” In a subsequent paper, 
Tanner-Smith and Risser explore the variability of effects across different outcome measures.”® 

We found that MI does not reduce days of cannabis use compared to TAU. Recent reviews 
have reached mixed conclusions regarding effects on cannabis use. A SR/MA by Li et al. that 
identified 10 randomized trials evaluating MI interventions for illicit drug use in adolescents.7°* 
They pooled use of multiple illicit substances, including cannabis (80%), cocaine (30%) and 
amphetamines/MDMA (20%) and concluded that there was no statistically significant effect of 
MI on drug use behaviors.** A SR/MA of adolescents and young adults,” found that brief 
behavioral interventions targeting both alcohol and other illicit drugs effectively reduced use of 
“both of these substances.” The review concludes that brief interventions that targeted only 
alcohol had no statistically significant secondary effects on untargeted illicit drug use.” Our 
analyses of cannabis outcomes included all studies that reported a cannabis-specific outcome. As 
we discuss in the Limitations of the Evidence Base section, it was often unclear if specific 
substance use was targeted, and study participants often used multiple substances. 

Given the apparent heterogeneity of treatment effects for alcohol and cannabis, it may be 
problematic to interpret effects for outcomes that combine multiple substances (e.g., alcohol, 
cannabis, and other drugs), as prior SRs have done. 


Nonbrief Behavioral Interventions 


Previous SRs have highlighted specific interventions and combinations of interventions as 
well established or showing particular promise for reducing substance use in adolescents. A 2018 
SR and qualitative synthesis by Hogue et. al. identified several interventions as “well 
established.””’ cognitive behavioral therapy (CBT, delivered both individually and in group 
format), Fam (delivered with an ecological orientation), MI + CBT, and MI + CBT + Fam 
(delivered with a behavioral orientation). Additional models were identified as “probably 
efficacious,” including: MI, Fam (delivered with a behavioral orientation), and several multi- 
component interventions the include contingency management.”’ 

The SR/MA by Tanner-Smith et. al. of 61 experimental or quasi-experimental studies 
concluded that “most substance use treatment programs were beneficial in helping adolescents 
reduce their substance use when those treatment programs provide tailored treatment services 
beyond standard community services. Fam and CBT programs showed particular promise of 
effectiveness, and no program types showed evidence of harmful effects.”””° 


80 


We performed separate network meta-analyses (NMA) for each substance specific outcome. 
This results in sparse networks and a reliance on primarily indirect evidence. Our NMA of the 
alcohol use days outcome suggests that intensive behavioral intervention with the entire family 
present (Fam) may be particularly effective. Furthermore, Fam may be more effective than 
intensive case management, CBT and MI. 

We found little evidence to support the effectiveness of any intervention to reduce cannabis 
use days. Indeed, we found that CBT, CBT+MI and CBT+MI+CM and Educ may result in 
relative increases in cannabis use compared to TAU. These conclusions are tentative, but if true, 
imply that there may be treatment effect heterogeneity by substance. 


Pharmacologic Interventions 


Only four studies evaluated treatment of opioid use disorder in adolescents or young adults. 
All addressed pharmacologic options for short-term opioid detoxification. There are currently 
three Food and Drug Administration (FDA)-approved medications for opioid use disorder in 
adults. For two of these (naltrexone and methadone) we found no studies in adolescents. None of 
the included studies evaluated long-term medication-assisted treatment. 


Pharmacologic Treatment of Psychiatric Comorbidities in 
Adolescents With Substance Use Disorders 


The narrative review by Brewer et. al. concludes that psychiatric and substance use disorder 
comorbidity is the rule rather than the exception.?’! We reviewed outcomes from 10 RCTs of 
pharmacotherapies used for ADHD, bipolar disorder and depression in adolescents with 
concomitant substance use. No study demonstrated superior comparative effects on substance 
use outcomes in subjects given pharmacotherapy compared to placebo. However, most studies 
were small, with resultant imprecision (wide confidence intervals). Of note, a single RCT*** 7°! 
that evaluated fluoxetine with CBT+MI for comorbid depression found improvements in 
depression. Notably, none of the other 9 RCTs found demonstrated an improvement in the target 
psychiatric disorder. 


Applicability 

A number of factors may limit the applicability of our findings. 

We aggregated brief behavioral interventions from studies done in various settings (e.g., 
emergency department (ED), inpatient, outpatient primary care, juvenile justice). Treatment 
effects may be moderated by context specific factors. For example, brief interventions in the ED 
after an alcohol-related presentation may represent a “teachable moment,” or alternatively, the 
saliency of the event may prompt self-change.?”” 

The diagnostic criteria for substance use disorders are well defined, albeit with variation by 
DSM version. However, our pragmatic inclusion criteria for problematic use necessarily defined 
a more heterogeneous group of substance users, likely with substantial variability in the degree 
of impairment. 

Study inclusion criteria varied with regards to the primary substance of misuse, as detailed in 
Appendix D Some studies explicitly focused on adolescents who primarily misused a specific 
substance (i.e. alcohol or cannabis) and reported use-related outcomes for that substance only. 
However, other studies enrolled adolescents who misused a combination of substances, most 
commonly alcohol and cannabis, and reported some combination of cannabis and alcohol 
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outcomes. Other studies reported outcomes for composite use of unspecified substances (e.g., 
“illicit drug use’”’). 

Despite this apparent heterogeneity of inclusion criteria, most studies enrolled alcohol and 
cannabis users (see Appendix Tables D-1 and D-2), with a minority using other drugs. Within 
studies, details of specific substances use were often incompletely reported (see Appendix Table 
D-3). 

Behavioral interventions sometimes explicitly targeted multiple substances, e.g. alcohol and 
other drug use. Unlike some pharmacologic interventions, behavioral interventions are not 
inherently substance-specific. We therefore chose to aggregate our analysis by substance specific 
use outcomes, rather than attempting to disentangle effects for a specific use disorder or 
problematic use of alcohol or cannabis. This choice may limit the applicability of our 
conclusions to users of a single substance. Furthermore, this approach does not account for 
possible interaction effects between outcomes within a study, e.g. interventions that successfully 
target alcohol use might result an increase cannabis use due to substitution of cannabis for 
alcohol.” 

The specific outcomes reported in each substance-of-use category are detailed for each study 
in Appendix E-1 (Brief interventions) and E-2 (Nonbrief interventions). Table 33 below, 
summarizes the number of behavioral studies in each intervention category that reported an 
alcohol outcome only, a cannabis outcome only, or both an alcohol and a cannabis outcome. 


Table 33. Number of meta-analyzed studies reporting outcomes for alcohol only, cannabis only, or 
both 


Intervention AlcoholOnly Cannabis-Only Alcohol & 
Type Outcomes Outcomes Cannabis 
Brief 7 7 7 
Intensive 6 10 9 


Alcohol only outcomes: heavy-use days, use days, abstinence; Cannabis-only outcomes: use days, abstinence 


A few studies explicitly focused on adolescents with SUD and a specific comorbid mental 
health diagnosis, whereas most studies focused on adolescents with SUD and often did not report 
on the frequency of comorbid psychiatric comorbidities. 

Thus, even when samples were selected based on a specific substance or specific comorbid 
diagnosis, the populations identified were generally heterogeneous samples of polysubstance 
using adolescents, many of whom likely have psychiatric comorbidities. 

Interventions identified across studies are multicomponent, complex interventions. Rather 
than simply comparing “brand name” therapy models, we attempted to identify a common set of 
core intervention components. Classification of active intervention components was dependent 
on the quality of reporting, and in many cases, specific intervention components were not well 
described. Determination of the list of classification components of interest and classification of 
the components for each study required judgements. 

Comparator conditions — often generally described as treatment as usual (TAU) — were 
particularly challenging to classify, as the TAU category defines a heterogeneous collection of 
often poorly described active interventions. Any classification of interventions cannot perfectly 
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capture the complexity of these interventions and relies on highly variable reporting in published 
reports. 


Implications for Clinical and Policy Decision Making 


As summarized in Table 32, there is evidence for the effectiveness of brief behavioral 
interventions for adolescents with problematic alcohol use. This supports the expansion of 
current initiatives to implement screening, brief intervention and referral to treatment (SBIRT) 
adolescents with alcohol use.?”* However, based on the evidence, it should not be assumed that 
brief interventions have equal effects on alcohol and cannabis. In particular, brief motivational 
interviewing appears to be ineffective for adolescents with problematic cannabis use. 

Limited evidence suggests that family focused behavioral interventions may be particularly 
effective in the treatment of alcohol use disorder. No intervention or combination of intensive 
interventions demonstrated a definite positive effect on increasing abstinence or decreasing 
overall cannabis use. 

Evidence that longer courses of buprenorphine are more effective in the short-term 
management of opioid withdrawal supports recommendations for increased utilization of 
buprenorphine for longer-term maintenance therapy.'” 77° 


Limitations of the Systematic Review Process 


In our analyses, we used both direct and indirect information to inform comparisons between 
interventions. When interpreting the results, it is important to note that indirect comparisons rely 
on an assumption of consistency between indirect and direct evidence. For nonbrief behavioral 
interventions, the multiplicity of interventions and intervention components resulted in very 
sparse direct evidence. 

We chose to rate an intervention component as present only if the intervention was well- 
specified, as evidenced by use of a manual or fidelity monitoring. There were some multi- 
component interventions in which the intervention was well-specified and monitored, but 
specific elements were much less so. Decisions about how to code these interventions were 
challenging and were directly influenced by the quality of intervention reporting. The use of a 
codebook and independent coding by three raters, one of which was a content expert and one of 
which was a methodological expert in multi-component interventions, helped to ensure that we 
used a consistent approach. 


Limitations of the Evidence Base 


For many topics, evidence was sparse and indeterminate — or absent entirely. The bulk of 
evidence relates to adolescents with problematic use or substance use disorders related to alcohol 
or cannabis. 

Overall, we found very few studies in adolescents or young adults (ages 25 or less) that 
evaluated pharmacologic or combined pharmacologic and behavioral interventions. We 
identified 988 trials in adults that enrolled participants 18 years and older but found none that 
provided an extractable analysis of the adolescent/young adult subgroup. 

The evidence regarding treatment of psychiatric comorbidities is quite limited. For the 
treatment of ADHD, we found no studies that evaluate agents that may have less potential for 
abuse (e.g., guanfacine and clonidine). 
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Outcomes were measured and reported inconsistently. Most studies reported multiple 
outcomes. The most commonly reported outcome across studies was self-reported substance use 
days. However, use days were summarized over variable denominators (e.g., 7, 30, or 90 days), 
expressed as percent or log- or square root-transformed. Other studies quantified indicators of 
abstinence or substance-related problems use using a variety of scales. The lack of consistently 
reported outcomes across studies reduced the number of available comparisons. 

The available evidence was too sparse to allow identification of key ingredients of successful 
interventions (moderators of treatment effect) or how intervention effects differ across 
demographic groups. 

Studies took a wide variety of approaches to missing data in subjects who dropped out of 
treatment. When available, we preferred intention-to-treat analyses or model-based expected 
means. However, studies often reported only raw summary data based on number analyzed. 


Recommendations for Future Research 


There is a need to adopt a set of core outcome measures and standard approaches to reporting 
of these outcomes. For example, among studies to date, a wide range of outcomes have been 
used, including measures of frequency of use, abstinence, and substance-related problems. Even 
among studies that measure “frequency of use,” the metrics used (e.g., count of days, proportion 
of days), specific substances of focus, and recall periods vary substantially. This required us to 
synthesize data over different recall periods. If all studies had consistently reported a core 
outcome set utilizing common measures, our summary findings would have been more reliable. 
Ideally, abstinence and use in studies would be modeled jointly, and may best be synthesized 
using a hurdle model utilizing individual patient data from individual studies.””° *”’ 

The observed variability of treatment effects by substance suggests it may difficult to 
interpret composite outcomes (i.e., alcohol and other drugs, illicit drugs and other drugs). If 
treatment effects vary by substance, estimates of composite effects will be determined by the 
relative proportion of alcohol, cannabis, and other drug use in individual studies. Furthermore, 
the increasing potency of cannabinoid products over time may impact response to therapy.” 

A core outcome set would be especially valuable if it included standardized definitions of 
patient-centered outcomes, such as adolescent functioning in school, peer, and family domains. 
Some studies included secondary functional outcomes, but such outcomes were included 
inconsistently and varied across reports. More data on functional outcomes are needed to 
determine whether the reductions in days of use documented in this report translate into 
meaningful clinically improvements for adolescents. 

To support evidence synthesis, studies need to more clearly describe intervention 
components received by study participants, including those assigned to TAU. For example, 
rather than simply stating that an intervention was designed to “build motivation” or “build 
skills,” investigators should clearly explicate the underlying theoretical orientation of the 
intervention. In addition, each unique aspect of a multi-component intervention should be well- 
described, with references to a manual and supportive source materials. Data on fidelity 
monitoring should ideally be provided for each major component underlying the intervention. 

Large “adult” trials that enroll older adolescents (age 18 to 20) should consider reporting this 
subgroup. 

Future research should also seek to clarify whether specific subpopulations may benefit from 
specific intervention components. Specifically, studies should seek to clarify which interventions 
are most effective for a given primary substance of misuse, severity of use, and how 
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effectiveness is moderated by the presence of co-occurring psychiatric disorders. Much of this 
research in the United States is funded by the National Institutes of Health via the National 
Institute on Drug Abuse (NIDA) and the National Institute on Alcohol Abuse and Alcoholism 
(NIAAA). Harmonized guidance from these agencies with respect to core outcomes might be 
particularly impactful. 


Conclusions 


Compared with TAU (e.g., brief advice and a handout), brief MI for adolescents with 
problematic substance use increases the likelihood of abstinence from alcohol and reduces both 
heavy alcohol use and overall days of use. However, brief MI did not decrease cannabis use. MI 
may decrease problems related to substance use, such as missed school or work or getting into 
trouble. 

Among intensive interventions, Fam (with a focus on intervening in the entire family system) 
may be the most effective in reducing both days of heavy alcohol and overall alcohol use. 

For opioid use disorder, buprenorphine and buprenorphine-naloxone are more effective in the 
short term management of opioid withdrawal if they are tapered over a longer period of time (i.e. 
12 weeks versus 2 weeks, 56 days versus 28 days). Studies of long-term pharmacologic and/or 
behavioral treatment of opioid use disorder are urgently needed. 

Further research is needed to identify: 1) brief and more intensive interventions for 
problematic cannabis use and cannabis use disorder, 2) effective combinations of behavioral 
treatments and medication to treat alcohol and cannabis use disorders, and 3) interventions that 
improve outcomes that are most meaningful to adolescents, such as better functioning in school 
and improved relationships with peers and parents. 
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Appendix A. Search Strategies 


Primary Search for All Substances in Adolescents 
PubMed last run 10/31/2019 


(((“Suvenile Delinquency/rehabilitation” [MeSH Terms] OR (juvenile AND (offender* or 
delinquency or prison)) OR ("Substance-Related Disorders"[Mesh] NOT ("Substance-Related 
Disorders/prevention and control"[Mesh] NOT "Substance-Related Disorders"[Mesh])) OR 
“drug offense” OR “Drug abuse” OR “drug misuse” OR “drug dependence” OR “drug 
addiction” OR “substance use” OR “substance abuse” OR “substance misuse” OR “substance 
dependence” OR “substance addiction” OR “prescription abuse” OR “Alcoholism”[Mesh] OR 
“cannabis use disorder” OR “alcohol use disorder” OR “stimulant use disorder” OR 
“hallucinogen use disorder” OR “opioid use disorder” OR “inhalant use disorder”) OR 
((Alcohol OR “Alcoholic Beverages” [Mesh] OR cannabis OR Marijuana OR “Cannabis” [Mesh] 
OR “Marijuana Abuse” [Mesh] OR “Marijuana Smoking”[Mesh] OR opioids OR 

“Narcotics” [Mesh] OR “Analgesics, Opioid” [Mesh] OR kratom OR hallucinogens OR 
“Psychotropic Drugs’ [Mesh] OR inhalants OR toluene OR ((amyl OR butyl OR isobutyl) AND 
nitrites) OR stimulants OR “Central Nervous System Stimulants”[Mesh] OR 

“Amphetamines” [Mesh] OR Sedatives OR “Hypnotics and Sedatives”[Mesh] OR 
Benzodiazepines OR “Benzodiazepines” [Mesh] OR Anthramycin OR Bromazepam OR 
Clonazepam OR Devazepide OR Diazepam OR Flumazenil OR Flunitrazepam OR Flurazepam 
OR Fentanyl OR Alprazolam OR Clonidine OR Hashish Clonidine OR Lorazepam OR 
Nitrazepam OR Oxazepam OR Pirenzepine OR Prazepam OR Temazepam OR 
Chlordiazepoxide OR Clorazepate Dipotasstum OR Estazolam OR Medazepam OR Midazolam 
OR Triazolam OR opioid* OR opiate* OR Heroin OR opium OR “Morphine 

Derivatives” [Mesh] OR Codeine OR Hydrocodone OR Oxycodone OR Dihydromorphine OR 
Ethylmorphine OR Heroin OR Hydromorphone OR Morphine OR Oxymorphone OR Thebaine 
OR Cocaine OR “Cocaine” [Mesh] OR Methamphetamine* OR “Methamphetamine” [Mesh] OR 
Benzphetamine OR anabolic steroids OR “Testosterone Congeners” [Mesh] OR antihistamines 
OR nitrous oxide OR betel nut OR kava OR Ecstasy OR phenylalkylamines OR mescaline OR 
2,5-dimethoxy-4-methylamphetamine OR MDMA OR 3,4-methylenedioxymethamphetamine 
OR indoleamine* OR psilocybin OR psilocin OR dimethyltryptamine OR ergoline* OR 
lysergic acid diethylamide OR “morning glory seeds” OR “Salvia divinorum” OR jimsonweed 
OR anxiolytic OR benzodiazepine* OR zolpidem OR zaleplon OR carbamate* OR glutethimide 
OR meprobamate OR barbiturate* OR secobarbital OR barbiturate* OR glutethimide OR 
methaqualone OR amphetamine OR dextroamphetamine OR methamphetamine OR gabapentin 
OR baclofen OR diacetylmorphine OR kratom OR polydrug OR “poly-drug” OR polysubstance 
OR “poly-substance” OR “injection drug”) AND (addict* OR abus* OR misus* OR disorder* 
OR mis-use OR dependen*))) 


AND 


(“Telemedicine/methods” [Mesh] OR “Active aftercare” OR “Adolescent Community 
Reinforcement Approach” OR “Alcoholics Anonymous” OR “Narcotics Anonymous” OR “12- 
step” OR “assertive community treatment” OR “assertive continuing care” OR “Behavior 
Therapy’ [Mesh] OR “brief intervention” OR “brief interventions” OR “Brief negotiated 
interview” OR “brief strategic family therapy” OR “Buprenorphine, Naloxone Drug 
Combination’ [Mesh] OR “Buprenorphine”[Mesh] OR “Cognitive behavioral therapy” OR 
“Cognitive Therapy’ [Mesh] OR “Cognitive-behavioral therapy” OR “Cognitive-behavioral 
treatment” OR “Combined Modality Therapy’ [Mesh] OR “Contingency management” OR 
“Culturally Informed and Flexible Family-Based Treatment for Adolescents” OR “culturally- 
based intervention” OR “delinquency-treatment programs” OR “dopaminergic agent” OR “drug 
counseling” OR “Dual diagnosis therapy” OR “Dual diagnosis treatment” OR “Dual Recovery 
Therapy” OR “Family Therapy’[Mesh] OR “glutaminergic agent” OR “group therapy” OR 
“Harm reduction” OR “Interpersonal process groups” OR “Matrix-Model” OR “medication 
assisted treatment” OR “Methadone”[Mesh] OR “Motivational Enhancement Therapy” OR 
“Motivational incentives” OR “motivational interview” OR “motivational interviewing” OR 
“Motivational Interviewing” [Mesh] OR “Multidimensional Treatment Foster Care” OR 
“Multisystemic Therapy” OR “mutual help group” OR “Naloxone” [Mesh] OR “Narcotic 
Antagonists” [Mesh]) OR “Opioid replacement” OR “Opioid substitution” OR “oral THC” OR 
“Phoenix Academy” OR “Recovery Coach” OR “Recovery High School” OR “Reinforcement- 
based” OR “Seeking Safety” OR “Self-Help for Alcohol and Other Drug Use and Depression” 
OR “seven challenges” OR “Skills development groups” OR “Substance Abuse Program” OR 
“synthetic cannabinoids” OR “synthetic opioid” OR “systemic Therapy” OR “Teen Marijuana 
Check-Up” OR “Therapy, Computer-Assisted” [Mesh] OR ((family OR psychosocial OR 
Psychoeducational) and (therapy or therapies or treatment* or intervention* or counseling)) OR 
(behavior* AND (intervention* OR modification*)) OR A-CRA OR Acamprosate OR Acomplia 
OR amiodarone OR Buprenorphine OR Bupropion OR Cannabidiol OR CIFFTA OR citalopram 
OR dexamfetamine OR dexamphetamine OR Disulfiram OR duloxetine OR escitalopram OR 
fluoxetine OR gabapentin OR lisdexamfetamine OR Lithium OR Long-acting injectable OR 
meditation OR Methadone OR mindfulness OR Nabiximols OR Naltrexone OR paroxetine OR 
Peer-based OR “peer support” OR pemoline OR Pharmacological interventions OR prazosin OR 
pregabalin OR quetiapine OR Rimonabant OR Sativex OR SBIRT OR sertraline OR Topiramate 
OR varenicline OR venlafaxine OR Vilazodone ) 


AND 


(“Randomized Controlled Trial’ [pt] OR "Cohort Studies"[Mesh] OR cohort OR "Clinical Trial" 
[Publication Type] OR longitudinal OR "Placebos"[Mesh] OR placebo* OR "Evaluation 
Studies" [Publication Type] OR "Comparative Study" [Publication Type] OR ((comparative or 
Intervention) AND study) OR pretest* OR preintervention OR posttest* OR prepost* OR “pre 
post” OR “before and after” OR interrupted time* OR time serie* OR ((quasi-experiment* OR 
quasiexperiment* OR quasi or experimental) and (method or study or trial or design*)) OR 
"Random Allocation"[Mesh] OR "Double-Blind Method"[Mesh] OR "Single-Blind 
Method"[Mesh] OR ((clinical OR controlled) and trial*) OR ((singl* or doubl* or trebl* or 
tripl*) and (blind* or mask*)) OR random*) 


AND 


(adolescent [MeSH] OR adolescen* OR teen* OR young people OR young person* OR young 
adult* OR youth* OR girl OR girls OR boy OR boys OR juvenile* OR "Young Adult"[Mesh])) 


A-2 


NOT 


(((‘“adult”[mesh] OR "Infant"[Mesh] OR “child” [mesh]) NOT “adolescent”[mesh]) OR neonat* 
OR infant* OR “addresses” [pt] or “autobiography” [pt] or “bibliography” [pt] or “biography” [pt] 
or “case reports” [pt] or “comment” [pt] or “congresses” [pt] or “dictionary” [pt] or “directory” [pt] 
or “festschrift” [pt] or “government publications” [pt] or “historical article” [pt] or “interview” [pt] 
or “lectures” [pt] or “legal cases” [pt] or “legislation” [pt] or “news” [pt] or “newspaper article” [pt] 
or “patient education handout” [pt] or “periodical index”’[pt] or "comment on" or 
("Animals"[Mesh] NOT "Humans"[Mesh]) OR rats[tw] or cow[tw] or cows[tw] or chicken*[tw] 
or horse[tw] or horses[tw] or mice[tw] or mouse[tw] or bovine[tw] or sheep or ovine or murinae 
or “animal model’’) 


Cochrane last run on 10/31/19 
ID Search Hits 
#1 MeSH descriptor: [Substance-Related Disorders] explode all trees 


#2 alcohol* or cannabis or marijuana or opioid* or narcotic* or hallucinogen* or 
psychotropic or stimulant* or opiate* or steroid* or polydrug or polysubstance or drug* or 
substance* or prescription 


#3 addict* or abus* or misus* or mis-use or dependen* 

#4 #2 NEAR #3 

#5 #1 OR #4 

#6 treatment or therapy or intervention or counseling 

#7 #5 AND #6 

#8 adolescen* or teen* or "young people" or "young person" or "young adult" or "young 
adults" or youth* or girl or girls or boy or boys or juvenile* 

#9 #7 and #8 


CINAHL/PsycINFO last run on 10/31/19 


((alcohol* or cannabis or marijuana or opioid* or narcotic* or hallucinogen* or psychotropic or 
stimulant* or opiate* or steroid* or polydrug or polysubstance or drug* or substance* or 
prescription) N1 (addict* or abus* or misus* or mis-use or dependen*)) 


AND 
(treatment or intervention or therapy or counseling) 
AND 


(adolescen* or teen* or "young people" or "young person" or "young adult" or "young adults" or 
youth* or girl or girls or boy or boys or juvenile*) 


AND 


(“Randomized Controlled Trial” OR "Cohort Studies" OR cohort OR "Clinical Trial" OR 
longitudinal OR "Placebos" OR placebo* OR "Evaluation Studies" OR "Comparative Study" 
OR ((comparative or Intervention) AND study) OR pretest* OR preintervention OR posttest* 
OR prepost* OR “pre post” OR “before and after” OR interrupted time* OR time serie* OR 
((quasi-experiment* OR quasiexperiment* OR quasi or experimental) and (method or study or 
trial or design*)) OR "Random Allocation" OR "Double-Blind Method" OR "Single-Blind 
Method" OR ((clinical OR controlled) and trial*) OR ((singl* or doubl* or trebl* or tripl*) and 
(blind* or mask*)) OR random*) 


Limit to journals, adolescent, young adult 


Embase last run on 10/31/19 


#19 

#4 AND #18 AND [embase]/lim AND ([(article]/lim OR [article in press]/lim) AND 
({adolescent]/lim OR [young adult]/lim) AND [humans]/lim 

7289 

#18 

#5 OR #6 OR #7 OR #8 OR #9 OR #10 OR #11 OR #12 OR #13 OR #14 OR #15 OR #16 OR 
#17 


#17 
‘cohort analysis'/exp OR ‘cohort analysis' 


#16 
‘longitudinal study'/exp OR ‘longitudinal study' 


#15 
‘clinical study'/exp OR ‘clinical study' 


#14 
‘prospective study'/exp OR prospective study' 


#13 
randomly AND allocated 


#12 
‘random allocation' 


#11 
‘placebo'/de 


#10 
‘crossover procedure'/de 


#9 
‘double blind procedure'/de 


#8 
‘single blind procedure'/de 


#7 
‘randomization'/exp OR 'randomization' 


#6 
‘randomized controlled trial'/exp OR 'randomized controlled trial' 


#5 
‘clinical trial'/exp OR ‘clinical trial’ 


#4 
#1 AND #2 AND #3 AND ({article]/lim OR [article in press]/lim) AND [humans]/lim 


#3 
adolescen* OR teen* OR 'young people' OR 'young person' OR ‘young adult' OR 'young 
adults' OR youth* OR girl OR girls OR boy OR boys OR juvenile* 


#2 
treatment OR therapy OR intervention OR counseling 


#1 

‘drug offense'/exp OR 'drug offense' OR 'drug abuse'/exp OR ‘drug abuse’ OR 'drug 
misuse'/exp OR 'drug misuse’ OR 'drug dependence'/exp OR 'drug dependence’ OR 'drug 
addiction'/exp OR ‘drug addiction' OR 'substance use'/exp OR 'substance 

use’ OR ‘substance abuse'/exp OR 'substance abuse’ OR ‘substance misuse'/exp 

OR ‘substance misuse’ OR 'substance dependence'/exp OR ‘substance 

dependence’ OR ‘substance addiction'/exp OR ‘substance addiction' OR 'prescription 
abuse' OR 'alcoholism'/exp OR ‘alcoholism' OR 'cannabis use disorder'/exp OR ‘cannabis 
use disorder’ OR ‘alcohol use disorder'/exp OR ‘alcohol use disorder' OR 'stimulant use 
disorder' OR ‘hallucinogen use disorder' OR 'opioid use disorder'/exp OR ‘opioid use 
disorder’ OR ‘inhalant use disorder' 


CT.gov last run 10/31/19 


Substance Use OR Substance Abuse OR Drug Abuse OR drug dependence OR drug addiction 
OR prescription abuse OR Alcoholism OR cannabis OR alcohol OR stimulant OR hallucinogen 
OR opioid OR inhalant 


adolescent OR teen OR young people OR young person OR young adult OR youth OR juvenile 


Search for Systematic Reviews of Alcohol in College Settings 
PubMed last run 10/31/19 


(“Alcoholism” [Mesh] OR “alcohol use disorder” OR "Alcohol Drinking"[Mesh] OR pregam* 
OR ((Alcohol* OR “Alcoholic Beverages” [Mesh] OR drink*) AND (addict* OR disorder* OR 
abus* OR misus* OR mis-use OR dependen* OR binge OR heavy OR problematic OR high- 
risk))) 


AND 


(colleg*[tiab] OR undergraduate*[tiab] OR "Universities"[Mesh] OR University[tiab] OR 
universities| tiab]) 

AND 

(systematic[sb] OR meta-analysis[pt] OR meta-analysis as topic[mh] OR meta-analysis[mh] OR 
meta analy* OR metanaly* OR metaanaly* OR met analy* OR (systematic AND (review* OR 
overview*)) OR "Review Literature as Topic"[Mesh] OR Cochrane[tiab] OR embase[tiab] OR 
(psychlit[tiab] or psyclit[tiab]) OR (psycINFO[tiab] or psycinfo[tiab])OR (cinahl[tiab] or 
cinhal[tiab]) OR science citation index[tiab] OR bids[tiab] OR cancerlit[tiab] OR reference 
list*[tiab] OR bibliograph*[tiab] OR hand-search*[tiab] OR relevant journals[tiab] OR manual 
search*[tiab] OR selection criteria[tiab] OR data extraction|[tiab]) 


Cochrane/Epistemonikos last run 10/31/19 


(((Alcohol* OR drink*) AND (addict* OR disorder* OR abus* OR misus* OR mis-use OR 
dependen* OR binge OR heavy OR problematic OR high-risk)) OR pregam*) 


AND 
(colleg* OR undergraduate* OR University OR universities) 


A-6 
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Appendix C. Intervention Coding Manual 


Determinations for Each Study 


1. Intervention type? (category: Drug; Behav; Drug & Behav) 
2. Drugs used (text=drug(s) used in each arm, if applicable) 
2a. Drug note (text=details reported about drug dose, delivery, frequency, etc.) 
3. Source (text=additional sources other than primary extracted PMID [e.g., included co-pubs, 
protocols, cited manuals] used to code intervention content) 


Table C-2. Determinations for Each Arm 


LABELS 
4. SRDR arm name (text=comprised of content labels in order of appearance in extraction sheet) 
5. Article arm name (text=specific label for arm as written in article) 
6. Is the intervention (as a whole, if includes multiple content components below) well specified? 
(binary: 0=no; 1=yes) 
Code YES if: 
Intervention has a specific name that describes the approach 
e Primary intervention of interest is guided by a manual or comparable guide to ensure that 
others could replicate the approach 
e The study references treatment fidelity or adherence 
Code NO if: 
e Intervention is generally not well specified 
7. Is the intervention well specified note? (text=specific text describing why intervention is/is 
not well specified). Consider TIDieR checklist. 
INTERVENTION CONTENT 
8. Content: Cognitive behavioral (binary: 0=no; 1=yes) 
Code YES if: 
e Intervention described as focusing on changing the adolescent’s thoughts and/or 
behaviors 
e Common brand names may include: 
o Adolescent Community Reinforcement Approach (ACRA) 
o Dialectical Behavior Therapy (DBT) 
o Cognitive Behavioral Therapy (CBT) 
o Cognitive Therapy (CT) 
Code NO if: 
e No mention of cognitive behavioral therapy 
9. Content: Cognitive behavioral note (text=specific labels and/or text to support content label) 
10. Content: Motivation building (binary: 0=no; 1=yes) 
Code YES if: 
e Intervention described as focusing on increasing the adolescent’s motivation to change 
e Common brand names may include: 
o Motivational Interviewing (MI) 
o Brief Motivational Intervention (BMI) 
o Motivation-Enhancement Therapy (MET) 
Code NO if: 


C-1 


e No mention of motivation-building therapy 
11. Content: Motivation building note (text=specific labels and/or text to support content label) 
12. Content: Educational (binary: 0=no; 1=yes) 
Code YES if: 
e The intervention is described as psychoeducation, education, or general education 
e Common brand names may include: 
o Psychoeducation(al) (PE) 
o Psychoeducation therapy or treatment (PET) 
o Education (ED or EDUC) 
Code NO if: 
e No mention of psychoeducation or education 
13. Content: Educational note (text=specific labels and/or text to support content label) 
14. Content: Family focused (binary: 0=no; 1=yes) 
Code YES if: 
e Common descriptions may include: 
o Family therapy 
o Family-based therapy 
o Family strategic therapy 
e Common brand names may include: 
Brief Strategic Family Therapy (BSFT) 
Ecological Family Therapy 
Ecologically Based Family Therapy (EBFT) 
Educational Family Therapy 
Family Behavioral Therapy (FBT) 
Family Functional Therapy/Functional Family Therapy (FFT) 
Family Systems Therapy (FST) 
Family Systems Network (FSN) 
Multidimensional Family Therapy (MDFT) 
o Multi-systemic Therapy (MST) 
e The intervention will include BOTH teen and a parent or legal guardian. Do NOT select 
this category if the intervention targets sibling only or teen + sibling or parents only 
Code NO if: 
e No mention of family therapy 
15. Content: Family focused note (text=specific labels and/or text to support content label) 
16. Content: Contingency management (binary: 0=no; 1=yes) 
Code YES if: 
e Intervention described as using contingency management, motivational incentives, 
vouchers, or prize draws 
e Common brand names may include: 
o Contingency management (CM) 
o Motivational Incentives 
o Voucher-Based Therapy 
Code NO if: 
e No mention of contingency management 
17. Content: Contingency management note (text=specific labels and/or text to support content 
label) 


0-0. 0: OO’ 0: 0:0: -O 


18. Content: Peer group therapy (binary: 0=no; 1=yes) 
Code YES if: 
e Intervention described as providing peer group therapy (e.g. nondirective therapy 
interventions) delivered to 
adolescents in a group format 
Code NO if: 
e No mention of peer group therapy 
19. Content: Peer group therapy note (text=specific labels and/or text to support content label) 
20. Content: Intensive case management (binary: 0=no; 1=yes) 
Code YES if: 
e Intervention described as providing support to link adolescents to supportive services 
(e.g., continuity of care, etc.) 
Code NO if: 
e No mention of peer group therapy 
21. Content: Intensive case management note (text=specific labels and/or text to support content 
label) 


EFFECT MODIFIERS 
22. Brief duration (binary 0=no; 1=yes) 
Code YES if: 
e The intervention content is delivered in <2 sessions 
Code NO if: 
e The intervention context is delivered > 2 sessions 
23. Brief duration note (text=specific description of the duration and frequency of the 
intervention content above) 
24. Delivery group (binary: 0=no; 1=yes) 
The goal of the intervention is to address each individual adolescent’s substance use, but the 
delivery mechanism is simultaneous treatment of a group of adolescents 
Code YES if: 
e The intervention content is described as being delivered in a group format (i.e., delivered 
to multiple adolescents at the same time 
e Any intervention model is fine. Focus on whether the intervention is described as 
delivered in groups of adolescents 
Code NO if: 
e No mention of group therapy 
25. Delivery group note (text=specific description of the group format) 
26. Culturally accommodated intervention (binary: 0=no; 1=yes) 
Code YES if: 
e The intervention content is described as being culturally sensitive/culturally 
adapted/specific/tailored 
Code NO if: 
e No mention of cultural adaptation 
27. Culturally accommodated intervention note (text=brief description of how study was 
culturally sensitive; consider PROGRESS framework) 
28. Integrated intervention (binary: 0=no; 1=yes) 
Code YES if: 


e The intervention content is described targeting substance abuse and a co-occurring 
disorder 

Code NO if: 

e No mention of integrated intervention 
29. Integrated intervention note (text= specific description of the integrated intervention) 
30. General note (text=other information relevant to the intervention not already captured. Note, 
that this field should not be used to flag studies to be excluded but may be used to flag potential 
co-publications if not already linked. Also a place to note ordering (e.g., if a study compares 
MET + CBT vs. CBT + MET) 


Appendix D. Baselines 


Table D-1. Brief behavioral interventions — baseline data and interventions 


Author, Year 
PMID* 


Arnaud, 2015 
2016-03749- 
004 
(psychinfo) 


Arnaud, 2017 
27801991 


Bernstein, 
2009 
20053238 


Bernstein, 
2010 
20670329 


Braciszewski, 
2018 
132804409 
(embase) 


Brown, 2015 
26362000 


Colby, 2018 
29750362 


Cunningham, 
2015 
26347440 


D'Amico, 2008 
18037603 


320 


210 


853 


33 


151 


167 


836 


64 


Substances 
Used 


alcohol 


alcohol 


cannabis 


alcohol 
cannabis 


alcohol 
cannabis 
other drugs 


cannabis 
alcohol 


alcohol 


alcohol 
cannabis 
other drugs 


alcohol 
cannabis 


Severity 


PU 


PU 


PU 


PU 


PU 


SUD 


PU 


PU 


PU 


Ages 

[eligible] Male 
Mean % 
(sd) 

[16, 18] 47 
16.9 

(0.7) 

(nr, 18] 49 
15.7 

(1.2) 

(14, 21] 63 
nr 

(14, 21] 53 
nr 

[18, 19] 52 
18.9 

(0.5) 

(13, 17] 35 
15.8 (1) 

[17, 20] 59 
nr 

[14, 20] 52 
18.6 

(1.4) 

[12, 18] 48 
16 (1.8) 


Setting 


outpatient 
online 


hospital 
ED 


hospital 
ED 


hospital 
ED 


exiting 
foster care 


inpatient 
psychiatric 
hospital 


community 
outpatienr 


hospital 
ED 


primary 
care 


Intervention 
Delivery 


online 


hospital staff 


peer 
educators 


peer 
educators 


computerized 


research staff 
(Ph.D. 
psychologists, 
postdoctoral 
fellows) 


research staff 
(PhD 
psychologist, 
postdoctoral 
fellow, social 
worker) 


online, 
therapist (no 
detail) 


therapists (no 
detail) 


Arm Names 


1. TAU: “Control” 


2. MI: 
“WISEteens” 


1. TAU: 
“Treatment as 
usual” 


2. MI (parent): 
“Brief Ml” 


1. TAU: 
“Assessed control” 


2. MI: 
“Intervention” 


1. TAU: “Standard 
assessed control” 


2. MI: 
“Intervention” 


1. TAU: “Control” 


2. MI: “iHeLP” 


1. TAU: 
“Treatment as 
usual” 


2. Mi: 
“Motivational 
interviewing” 

1. TAU: “Attention 
control” 


2. MI: “Brief 
motivational 
intervention” 


1. TAU: “Control” 


2. MI: “Computer 
brief intervention” 


3. MI: “Therapist 
brief intervention” 
1. TAU: “Usual 
care” 


2. MI: “Project 
CHAT” 


Author, Year 
PMID* 


D'Amico, 2018 
30138016 


de Gee, 2014 
24969735 


Dembo, 2014 
2014-42452- 
005 
(psychinfo) 


Giles, 2019 
CN-01953820 
(cochrane) 


Marsden, 
2006 
16771893 


Martin, 2008 
17869051 


Martinez 
Martinez, 
2008 
2009-05582- 
007 
(psychinfo) 


Mason, 2015 
26234955 


McCambridge, 
2004 
14678061 


294 


171 


180 


443 


342 


40 


52 


119 


179 


Substances 
Used 


cannabis 
alcohol 


cannabis 


alcohol 
cannabis 
other drugs 


alcohol 


cannabis 
alcohol 
MDMA 
cocaine 


cannabis 
alcohol 
other drugs 


alcohol 


cannabis 
alcohol 


cannabis 
alcohol 
other drugs 


Severity 


PU 


PU 


PU 


PU 


PU 


PU 


PU 


PU 


PU 


Ages 


[eligible] 


Mean 
(sd) 
(12, 18] 
15.9 
(1.6) 


(11, 17] 
14.8 
(1.3) 


(14, 15] 
nr 


(16, 22] 
18.3 (2) 


(14, 19] 
16.5 
(1.3) 


(14, 18] 
16 (1.5) 


(14, 18] 
16.4 
(1.2) 


[16, 20] 
17.6 
(1.1) 


Male 


% 


45 


76 


65 


51 


67 


67 


65 


29 


55 


Setting 


outpatient 


primary 
care clinic 


outpatient 
community 


outpatient 
community 
(juvenile 
justice) 


outpatient 
school 


community 
outpatiet 


outpatient 
community 


outpatient 
school 


outpatient 
research 
clinic 


outpatient 
school 


Intervention 
Delivery 


facilitators 


community 
clinicians 
(prevention 
workers) 


therapists (no 
detail) 


school staff 
(learning 
mentors) 


community 
clinicians, 
research staff 
(no detail) 


therapists (no 
detail) 


therapists (no 
detail) 


therapists (no 
detail) 


research staff 
(PhD 
psychologist) 


Arm Names 


1. TAU: “Usual 
care” 


2. Ml: “CHAT 
intervention” 


1. MI: “"Weed 
Check" in Dutch” 


2. Educ: 
“Information 
session” 


1. TAU: “Standard 
truancy services” 


2. MI (parent): “BI- 
Youth and Parent” 


3. Ml: “Bl-Youth” 
1. TAU: “Control” 


2. MI: “Brief 
alcohol 
intervention” 


1. TAU: “Control” 


2. Mi: 
“Intervention” 


1. TAU: “Delayed 
treatment 
condition” 


2. MI: “Adolescent 
Cannabis Check- 
Up" 

1. TAU: “Control 
waitlist” 


2. MI: 
“Experimental” 


1. TAU: “Attention 
control condition” 


2. MI: “Peer 
network 
counselling” 


1. TAU: 
“Education-as- 
usual” 


2. MI: 
“Motivational 
interviewing” 


Author, Year 
PMID* 


McCambridge, 
2008 
18778385 


McCarty, 2019 
30883284 


Monti, 1999 
10596521 


Peterson, 
2006 
16938063 


Smith, 2015 
25951562 


Spijkerman, 
2010 
21169172 


Spirito, 2004 
15343198 


326 


148 


94 


285 


48 


575 


152 


Substances ‘ 
Used Severity 
cannabis PU 
alcohol 

other drugs 

alcohol PU 
cannabis 

alcohol PU 
alcohol PU 
cannabis 

amphetamines 

cocaine 

heroin 

unspecified PU 
alcohol PU 
alcohol PU 


Ages 


[eligible] 


Mean 
(sd) 


(16, 19] 
18 (1.7) 


(13, 18] 
nr 


[18, 19] 
18.4 
(0.5) 


(13, 19] 
17.4 
(1.5) 


(13, 17] 
15.6 
(1.2) 


Male 


% Setting 


69 outpatient 
school 


20 outpatient 


65 hospital 
ED 


55 outpatient 
community 


77 outpatient 
community 


38 — outpatient 
online 


64 hospital 
ED 


Intervention 
Delivery 


research staff 
(PhD 
psychologist, 
psychology 
graduates) 


school 
providers 


research staff 
(no detail) 


research staff 
(Master's 
level 
therapists) 


therapists (no 
detail) 


online 


research staff 
(Bachelor's 
level 
therapists and 
Master's level 
therapists) 


Arm Names 


1. MI: 
“Motivational 
interviewing” 


2. Educ: “Drug 
information and 
advice-giving” 

1. TAU: “School- 
based health clinic 
visit” 


2. Mi: “Check 
Yourself feedback 
+ School-based 
health visit” 


1. TAU: “Standard 
card” 


2. MI: “Brief 
motivational 
interviewing” 

1. TAU: 
“Assessment only” 


2. TAU: 
“Assessment at 
follow-up only” 


3. MI: “Brief 
motivational 
enhancement” 


1. MI: “MI” 


2. MI: “MI + 
normative 
feedback” 


1. TAU: “Control” 


2. MI: “Brief 
intervention 
without normative 
feedback” 


3. MI: “Brief 
intervention with 
normative 
feedback” 


1. TAU: “Standard 
care” 


2. Mi: 
“Motivational 
interview” 


Author, Year 
PMID* 


Spirito, 2011 
21383276 


Spirito, 2017 
29252011 


Srisurapanont, 
2007 
17453612 


Stein, 2011 
21531089 


Tait, 2004 
15194207 


Voogt, 2013 
CN-01122318 
(cochrane) 


Walker, 2006 
16822119 


N 


125 


69 


48 


189 


249 


609 


97 


Substances 
Used 


alcohol 


cannabis 
alcohol 
other drugs 


methamphetamine 


cannabis 
alcohol 


alcohol 
cannabis 
other drugs 


alcohol 


cannabis 
alcohol 
other drugs 


Severity 


PU 


PU 


SUD 


PU 


PU 


PU 


PU 


Ages 


[eligible] 


Mean 
(sd) 


(13, 17] 
15.5 
(1.2) 


(13, 18] 
15.8 
(1.4) 


(14, 19] 
16.9 
(1.4) 


(14, 19] 
nr 


(12, 19] 
16.7 
(1.7) 


(15, 20] 
17.3 
(1.3) 


(14, 19] 
15.8 
(1.2) 


Male 


% 


48 


59 


88 


nr 


48 


60 


48 


Setting 


hospital 
ED 


outpatient 
research 
clinic 
(juvenile 
justice 
truant 
court) 


outpatient 
research 
clinic 


residential 
(juvenile 
justice) 


hospital 
ED 


outpatient 
school 


outpatient 
school 


Intervention 
Delivery 


research staff 
(Master's 
level 
therapists) 


research staff 
(graduate 
students) 


therapists (no 
detail) 


research staff 
(no detail) 


research staff 
(no detail) 


online 


research staff 
(health 
educators) 


Arm Names 


1. MI (parent): 
“Individual 
Motivational 
Interview + Family 
Motivational 
Interview (Family 
Check Up)” 


2. MI: 
“Motivational 
interview” 


1. MI (parent): 
“Motivational 
enhancement 
therapy + Family 
Check Up” 


2. Educ: 
“Psychoeducation’ 


1. MI: “Brief 
intervention” 


2. Educ: 
“Psychoeducation’ 
1. TAU: 


“Relaxation 
training” 


2. MI: 
“Motivational 
interviewing” 

1. TAU: “Standard 
hospital care” 


2. ICM: “Usual 
hospital care + Bl 
focused on 
engagement” 


1. TAU: “Control” 


2. MI: 
“Experimental” 


1. TAU: “Waitlist 
control” 


2. MI: 
“Motivational 
enchancement 
therapy” 


Ages 


pari Wear N mee Severity ch se Setting atcha Arm Names 
(sd) 
Walker, 2011 310 cannabis PU (14, 19] 61 outpatient health 1. TAU: “Delayed 
21688877 alcohol 16 (1.2) school educators feedback control” 
other drugs (Bachelor's 
and Master's =. 2. MI: 
level “Motivational 
therapists) enhancement 
therapy” 
3, Educ: 
“Educational 
feedback control” 
Walker, 2016 252 cannabis PU (nr, nr] 68 outpatient researchstaff 1. CBT+MI: 
27762569 alcohol 15.8 (1) school (Bachelor's “Assessment only 
other drugs level check-in” 
therapists and 
Master's level 2. CBT+MI: 
therapists) “Motivational 
check-in” 
Winters, 2007 79 alcohol SUD (13, 17] 62 outpatient therapists (no —_1. TAU: “Control” 
17563146 cannabis 15.6 (nr) school detail) 
2. MI: “BI-A” 
3. MI: “BI-AP” 
Winters, 2012 315 cannabis PU (12, 18] nr outpatient therapists (no = 1. TAU: 
22000326 alcohol nr school detail) “Assessment only 
other drugs control” 


. PMID* = Pubmed identifier if available, otherwise (database name). Abbreviations: N=number randomized; PU = problematic 


2. MI (parent): 
“Brief Intervention 
- Adolescent Plus 
Parent Session” 


3. MI: “Brief 
Intervention - 
Adolescent Only” 


use; SD = standard deviation; ED = emergency department; nr = not reported; CBT = cognitive behavioral therapy; CM = 
contingency management; Edu = education; Fam = family therapy; ICM = intensive case management; MI = motivational 


interviewing; TAU = treatment as usual; parent = at least one component of the intervention included parent involvement/was 
targeted towards parents 


Table D-2. Nonbrief behavioral interventions — baseline data and interventions 


Ages 
pete sea N eri Severity rhea Setting aie Arm Names 
(sd) 
Amini, 1982 87 unspecified PU nr, nr] 69 inpatient research staff 1. TAU (group): “Inpatient” 
CN-00182281 16.1 (1) (experimental) — (psychiatry 
(cochrane) outpatient residents, 2. TAU: “Outpatient” 
community psychology 
(control) interns) 
Azrin, 1994 26 cannabis PU [nr, 18] 77 — outpatient research staff 1. PeerGroup (group): 
CN-00241903 cocaine 16 (nr) research clinic — (college “Supportive counseling” 
(cochrane) hallucinogens graduates, 
methamphetamine graduate 2. CBT (parent): “Behavioral 
benzodiazepines students) program” 
Azrin, 2001 56 alcohol SUD (12, 17] 82 outpatient research staff 1. Fam[behavioral] 
2002-13926- cannabis 15.4 research clinic (graduate (integrated): “Family- 
001 "hard drugs" (1.3) students) behavioral therapy” 
(psychinfo) 
2. CBT (integrated): 
“Individual-cognitive therapy” 
Baer, 2007 117 cannabis PU (13, 19] 56 outpatient therapists (no —- 1. TAU: “Treatment as usual” 
18072842 alcohol 17.9 community detail) 
other drug (1.2) (drop in 2. MI: “Brief motivational 
center) interview” 
Burrow- 35 unspecified SUD (13, 18] 94 outpatient research staff 1. CBT (group, cultural): 
Sanchez, 15.5 reseach clinic (graduate “Culturally accomodated CBT” 
2012 (1.3) (juvenile students) 
22866693 justice) 2. CBT (group): “Standard 
CBT” 
Burrow- 70 alcohol SUD (13, 18] 90 outpatient research staff 1. CBT (group, cultural): 
Sanchez, marijuana 15.2 reseach clinic (graduate “Culturally accomodated CBT” 
2015 other drugs (1.2) (juvenile students) 
25602465 justice) 2. CBT (group): “Standard 
CBT” 
D'Amico, 2013 193 cannabis PU (14, 18] 67 outpatient community 1. PeerGroup (group): “Usual 
CN-00917707 alcohol 16.6 community Clinicians care” 
(cochrane) (1.1) (control) 
research staff 2. MI (group): “Group 
(graduate motivational interviewing 
students; (FreeTalk)” 
experimental) 
Dakof, 2015 112 cannabis SUD (13, 18] 89 outpatient community 1. Fam[ecological]: 
25621927 alcohol 16 (1.1) community Clinicians “Multidimensional family 
other drug (juvenile therapy” 
justice) 


2. CBT+MI (group): 
“Adolescent group therapy” 


Author, Year 
PMID* 


Dennis, 2004 


15501373b 


Dennis, 2004 


15501373 


Esposito- 
Smythers, 
2011 

22004303 


Figurelli, 1994 


7862806 


Friedman, 
1989 
CN-00496580 
(cochrane) 


Godley, 2002 


12127465 


300 


213 


80 


48 


169 


114 


Substances 
Used 


cannabis 
alcohol 
other drugs 


cannabis 
alcohol 
other drugs 


cannabis 
alcohol 


alcohol 
other drugs 


alcohol 
cannabis 
other drugs 


alcohol 
cannabis 


Severity 


PU 


PU 


SUD 


PU 


PU 


SUD 


Ages 


[eligible] Male 
Mean % 
(sd) 

[12, 18] 85 
nr 

[12, 18] 84 
nr 

[13, 17] 33 
15.7 

(1.2) 

[13, 19] 62 
nr 

(14, 21] 61 
17.9 

(1.8) 

(12, 17] 80 
nr 


Setting 


outpatient 
community 


outpatient 
community 


outpatient 
research clinic 


outpatient 
community 


outpatient 
community 


outpatient 
community 


Intervention 
Delivery 


community 
Clinicians 


community 
Clinicians 


research staff 
(PhD 
psychologist, 
postdoctoral 
fellow; 
experimental) 
community 
Clinicians 
(control) 


therapists 
(substance 
abuse 
counselors) 


therapists (no 
detail) 


case 
managers 


Arm Names 


1. Fam[ecological] (cultural): 
“Multidimensional Family 
Therapy” 


2. CBT+MI (group): 
“Motivational Enhancement 
Therapy plus Cognitive 
Behavioral Therapy 
(MET/CBT) - 5 sessions” 


3. CBT (parent): “Adolescent 
Community Reinforcement 
Approach” 


1. CBT+MI+Educ+ICM (parent, 


group): “Family education and 
therapy components (Family 
Support Network)” 


2. CBT+MI (group): 
“Motivational Enhancement 
Therapy plus Cognitive 
Behavioral Therapy 
(MET/CBT) - 5 sessions” 


3. CBT+MI (group): 
“Motivational Enhancement 
Therapy plus Cognitive 
Behavioral Therapy 


(MET/CBT) - 12 sessions” 


1. TAU (integrated): 
“Enhanced TAU” 


2. CBT+MI (parent, integrated): 
“Integrated CBT” 


1. TAU: “TAU” 


2. CBT: “Cognitively-oriented 
pre-intervention” 


1. Famf[functional]: “Family 
therapy” 


2. CBT (parent, group): “Parent 
group” 


1. TAU: “Usual continuing 
care” 


2. CBT+ICM: “UCC plus an 
assertive continuing care 
protocol” 


Author, Year 
PMID* 


Godley, 2010 320 
20219293 


Godley, 2019 402 
CN-01745749 
(cochrane) 


Henderson, 126 
2016 
26992083 


Henggeler, 118 
1996 
8610836 


Henggeler, 161 
2006 
16551142 


Substances 
Used 


cannabis 
alcohol 
other drugs 


cannabis 
alcohol 
other drugs 


alcohol 
other drugs 


alcohol 
cannabis 
other drugs 


cannabis 
alcohol 
cocaine 


Severity 


SUD 


SUD 


PU 


SUD 


SUD 


Ages 


[eligible] Male 
Mean % 
(sd) 

[12, 18] 76 
nr 

[12, 18] 84 
nr 

(12, 17] 74 
15.2 

(1.1) 

(12, 17] 79 
15.7 (1) 

(12, 17] 83 
15.2 


(1.1) 


Setting 


outpatient 
community 


residential 
treatment 


outpatient 
community 
(juvenile 
justice) 


outpatient 
community 


outpatient 
community 
(juvenile 
justice) 


Intervention 
Delivery 


community 
Clinicians 


volunteers 


therapists (no 
detail) 


therapists (no 
detail; 
experimental); 
community 
Clinicians 
(control) 


community 
Clinicians 


Arm Names 


1. TAU (group): “Chestnut’s 


Bloomington Outpatient 
Treatment” 


2. CBT+MI+ICM (group): 
“Motivational Enhancement 
Therapy/Cognitive Behavior 
Therapy-7 session model + 
Assertive Continuing Care” 


3. CBT+MI (group): 
“Motivational Enhancement 
Therapy/Cognitive Behavior 
Therapy-7 session model” 


4. CBT+ICM (group): 
“Chestnut’s Bloomington 
Outpatient Treatment + 
Assertive Continuing Care” 


1. TAU: “Continuing care 
services as usual” 


2. CBT+ICM: “Volunteer 
recovery support for 
adolescents” 


1. TAU: “Services as usual 
(SAU)” 


2. CBT+ICM: “Adolescent- 
community reinforcement 
approach + assertive 
continuing care” 


1. TAU (group): “Usual 
community services” 


2. Fam[ecological]: “Home- 
based multisystemic therapy” 


1. PeerGroup (group): “Drug 


court with community services” 


2. PeerGroup (group): “Family 
court with community services” 


3. Fam[ecological]+PeerGroup 
(group): “Drug court + 
multisystemic therapy” 


4. 
Famfecological]+CM+PeerGro 
up (group): “Drug court + 
multisystemic therapy + 
contingency managment” 


Author, Year 
PMID* 


Henggeler, 
2012 
22309470 


Hogue, 2015 


25496283 


Joanning, 
1992 
CN-00631575 
(cochrane) 


Kaminer, 1998 


9824170 


Kaminer, 2002 


12436013 


Kaminer, 2008 


18978635 


Kelly, 2017 


28742932 


Killeen, 2012 


22299805 


Latimer, 2003 


12957348 


115 


297 


134 


32 


88 


144 


59 


31 


43 


Substances 
Used 


cannabis 
alcohol 
other drugs 


alcohol and other 
drugs 


alcohol 

cannabis 
amphetamines 
barbiturates 

or hallucinogens 


unspecified 


cannabis 
alcohol 


cannabis 
alcohol 


alcohol and other 
drugs 


cannabis 
other drugs 


cannabis 
alcohol 
other drugs 


Severity 


PU 


PU 


PU 


SUD 


SUD 


SUD 


SUD 


SUD 


SUD 


Ages 


[eligible] 


Mean 
(sd) 


(12, 17] 
15.4 (1) 


(12, 18] 
15.7 
(1.5) 


[11, 20] 
15.4 
(1.9) 


(14, 21] 
16.9 (2) 


(14, 18] 
15.5 
(1.2) 


(14, 17] 
nr 


Male 


% 


83 


52 


nr 


62 


70 


67 


B 


76 


Setting 


outpatient 
community 
(juvenile 
justice) 


outpatient 
community 


outpatient 
research clinic 


outpatient 
research clinic 


outpatient 
research clinic 


outpatient 
research clinic 


outpatient 
community 


outpatient 
community 


outpatient 
community 


Intervention 
Delivery 


community 
Clinicians 


community 
clinicians 


research staff 
(graduate 
students) 


therapist (no 
detail) 


therapists (no 
detail) 


therapists (no 
detail) 


therapists (no 
detail) 


therapists (no 
detail) 


Arm Names 


1. PeerGroup (group): “Usual 


services” 


2. Fam[ecological]+CM: 
“Contingency management 
and family engagement 
strategies” 


1. TAU: “Usual care other” 
2. Fam[systems/structural]: 
“Usual care family therapy” 
1. PeerGroup (group): 
“Adolescent group therapy” 


2. Fam[systems/structural]: 
“Family systems therapy” 


3. Fam[education] (group): 
“Family drug education” 

1. PeerGroup (group): 
“Interactional group treatment” 
2. CBT (group): “Cognitive- 
behavioral group treatment” 

1. Educ (group): 
“Psychoeducational therapy” 


2. CBT (group): “Cognitive 
behavioral therapy” 


1. TAU: “No-active aftercare” 


2. CBT+MI: “Brief telephone 
MI’ 


3. CBT+MI: “In-person MI” 


1. PeerGroup (group): 
“Integrated 12-step” 


2. CBT+MI (group): 
“MET/CBT” 


1. TAU: “Control + community 


treatment” 


2. CM: “Contingency 
management + community 
treatment” 


1. Educ (group): “Drugs harm 


psychoeducation curriculum” 


2. CBT+Fam|behavioral] 
(group): “Integrated family and 


cognitive-behavioral therapy” 


Author, Year 
PMID* 


Letourneau, 
2017 
27629581 


Liddle, 2001 


11727882 


Liddle, 2004 


15152709 


Liddle, 2008 


18705691 


Liddle, 2018 


29866383 


Lowe, 2012 


22931079 


Najavits, 2006 


16858633 


Ogel, 2011 


21609157 


107 


182 


80 


224 


113 


187 


33 


62 


Substances 


Used Severity 


cannabis PU 
alcohol 
cocaine 


cannabis PU 
alcohol 
and other drugs 


unspecified PU 


cannabis PU 
alcohol 
other drugs 


cannabis SUD 
alcohol 

stimulants 

opioids 


unspecified PU 


cannabis SUD 
alcohol 

hallucinogens 
amphetamines 

cocaine 

opioids 

inhalants 

barbiturates 


inhalant SUD 
cannabis 
other drugs 


Ages 


[eligible] 


Mean 
(sd) 


(11, 17] 
14.9 
(0.1) 


(13, 18] 
15.9 
(1.2) 


(13, 18] 
16.4 
(1.3) 


{nr, nr] 
16.1 
(1.2) 


(13, 18] 
15.3 
(1.4) 


Male 


% 


84 


nr 


72 


rhs) 


58 


nr 


Setting 


outpatient 
research clinic 
(juvenile 
justice) 


outpatient 
community 


outpatient 
community 


outpatient 
community 


outpatient 
community 


outpatient 
community 
(Native 
American 
tribal area) 


outpatient 
research clinic 


inpatient 


Intervention 
Delivery 


research staff 
(Master's level 
therapists) 


community 
Clinicians 


community 
Clinicians 


therapists 
(Ph.D. 
psychologists 
and Master's 
level 
therapists) 


community 
clinicians 


therapist and 
cultural expert 
(no detail) 


research staff 
(PhD 
psychologists, 
postdoctoral 
fellows) 


therapists (no 
detail) 


Arm Names 


1. TAU (group): “Usual 
services” 


2, CBT+Fam[behavioral]+CM: 
“Risk reduction therapy for 
adolescents” 


1. PeerGroup (group): 
“Adolescent group therapy” 


2. Fam[education] (group): 
“Multifamily educational 
intervention” 


3. Fam[ecologicall]: 
“Multidimensional family 
therapy” 


1. Fam[ecological]: 
“Multidimensional family 
therapy” 


2. CBT (group): “Peer group” 


1. Fam[ecological]: 
“Multidimensional family 
therapy” 


2. CBT: “Cognitive behavioral 
therapy” 


1. TAU (group): “Residential 


treatment” 


2. Fam[ecologicall]: 
“Multidimensional family 
therapy” 


1. PeerGroup (group, cultural): 


“Cherokee Talking Circle” 


2. Educ (group): “Standard 


Substance Abuse Education” 


1. TAU (integrated): 
“Treatment as usual” 


2. CBT (integrated): “Seeking 
Safety psychotherapy” 


1. Educ (group): “Control” 


2. CBT+Educ (group): 
“Experimental” 


Author, Year 
PMID* 


Rigter, 2013 


23140805 


Robbins, 2008 


18266532 


Robbins, 2011 


21967492 


Rohde, 2014 


24491069 


Rowe, 2016 


26879671 


Santisteban, 


2011 
21639636 


450 


190 


481 


170 


154 


28 


Substances 
Used 


cannabis 
alcohol 


cannabis 
cocaine 
other drugs 


cannabis 
alcohol 
other drugs 


cannabis 
alcohol 


cannabis 
alcohol 
other drug 


cannabis 
cocaine 
other drugs 


Severity 


SUD 


SUD 


PU 


SUD 


PU 


SUD 


Ages 


[eligible] Male 


Mean 
(sd) 


(13, 18] 


% 


85 


16.3 (nr) 


(12, 17] 
15.6 
(1.1) 


13, 17] 
5.2 
1.2) 


—~ 


13, 18] 
6.2 
(1.4) 


= 


(13, 17] 
15.5 
(1.3) 


(14, 17] 
nr 


78 


78 


74 


83 


nr 


Setting 


outpatient 
community 
(forensic 
centers) 


outpatient 
community 


outpatient 
community 


outpatient 
research clinic 


Residential 
(juvenile 
justice), 
Outpatient 
community 
(juvenile 
justice) 


outpatient 
community 


Intervention 
Delivery 


community 
Clinicians 


research staff 
(postdoctoral 
fellow, 
predoctoral 
intern, 
Master's level 
therapists) 


community 
Clinicians 


therapists 
(Master's level 
therapists; no 
detail) 


juvenile 
detention staff 


therapists (no 
detail) 


Arm Names 


1. TAU: “Individual 
psychotherapy” 


2. Fam[ecological]: 
“Multidimensional family 
therapy” 


1. TAU: “Community services 
control” 


2. Fam[systems/structural]: 
“Family process only” 


3. Famf[ecological]: “Fully 
integrated ecosystemic family 
approach” 


1. TAU: “Treatment as usual” 


2. Fam[systems/structural]: 
“Brief strategic family therapy” 


1. CBT+Fam[functional] 
(group, integrated): “FFT 
followed by CWD” 


2, CBT+Fami[functional] 
(group, integrated): “CWD 
followed by FFT” 


3, CBT+Fam[functional] 
(group, integrated): 
“Combining FFT and CWD 
(Coordinated treatment)” 


1. TAU (group, integrated): 
“Enhanced services as usual” 


2. Fam[ecological]: 
“Multidimensional family 
therapy” 


1: 
Ml+Educ+Fan[systems/structu 
ral] (cultural): “Culturally 
informed and flexible family- 
based treatment for 
adolescents (CIFFTA)” 


2. Fam[systems/structural]: 


“Traditional Family Therapy” 


Author, Year 
PMID* 


Santisteban, 
2015 
25799306 


Schaeffer, 
2014 
23958035 


Slesnick, 2005 


15878048 


Slesnick, 2007 


16989957 


Slesnick, 2009 


19522781 


Slesnick, 2013 


23895088 


Slesnick, 2015 


25736623 


Smith, 2006 


17182429 


40 


97 


124 


180 


119 


179 


270 


98 


Substances 
Used 


cannabis 
alcohol 
cocaine 


cannabis 
alcohol 
other drugs 


cannabis 
alcohol 
cocaine 
opiates 


cannabis 
alcohol 
other drugs 


alcohol 
cannabis 
other drugs 


unspecified 


cannabis 
alcohol 
other drugs 


cannabis 
alcohol 
other drugs 


Severity 


SUD 


PU 


PU 


SUD 


PU 


SUD 


SUD 


PU 


Ages 


[eligible] 


Mean 
(sd) 


(14, 17] 
nr (16) 


[15, 18] 
15.8 
(0.9) 


(12, 17] 
14.9 
(1.4) 


(14, 22] 
19.2 
(2.1) 


(12, 17] 
15.1 
(1.4) 


(12, 17] 
15.4 
(1.2) 


(14, 20] 
18.7 
(1.3) 


(12, 18] 
15.8 (nr) 


Male 


% 


1 


83 


M4 


66 


45 


48 


53 


1 


Setting 


outpatient 
community 
(juvenile 
justice) 


outpatient 
community 
(juvenile 
justice) 


outpatient 
community 


outpatient 
community 
(drop in 
center) 


outpatient 
community 


outpatient 
community 
(shelter) 


outpatient 
community 
(shelter) 


outpatient 
community 


Intervention 
Delivery 


research staff 
(Ph.D. 
psychologists; 
Master's level 
therapists) 


community 
Clinicians 


therapists (no 
detail) 


therapists (no 
detail) 


therapists (no 
detail) 


community 
Clinicians, 
research staff 
(graduate 
students) 


therapists (no 
detail) 


therapists (no 
detail) 


Arm Names 


1. TAU: “Individual drug 
counseling” 


2. 
CBT+Fam{systems/structural] 
(integrated): “Personality 
Disorder-Oriented Adolescent 
Family Therapy (I-BAFT)” 


1. TAU: “Community restitution 


apprentice-focused training” 


2. TAU: “Education as usual” 


1. TAU: “Service as usual” 


2. Fam[ecologicall]: 
“Ecologically based family 
therapy” 


1. TAU: “TAU through the drop 


in center” 


2. CBT: “Community 
reinforcement approach” 


1. TAU: “Service as usual” 


2. Fam[functional]: “Office- 
based functional family 
therapy” 


3. Fam[ecological]: “Home- 
based ecologically based 
family therapy” 


1. MI: “Motivational 
Interviewing” 


2. Fam[ecologicall]: 
“Ecologically-Based Family 
Therapy” 


3. CBT: “Community 
Reinforcement Approach” 


1. MI: “Motivational 
enhancement therapy” 


2. ICM: “Case management” 


3. CBT: “Community 
reinforcement approach” 


1. Fam[behavioral] (group): 
“Strengths oriented family 
therapy” 


2. CBT+Ml+PeerGroup 
(group): “The Seven 
Challenges” 


Author, Year 
PMID* 


Stanger, 2009 


19717250 


Stanger, 2015 


26004659 


Stanger, 2017 


28414474 


Thush, 2007 


16928395 


Tolou-Shams, 


2017 
CN-01365355 
(cochrane) 


Trudeau, 2017 


2017-00657- 
001 
(psychinfo) 


Wagner, 2014 


24841864 


Waldron, 2001 


11680557 


N 


69 


153 


75 


107 


60 


160 


514 


120 


Substances 
Used 


cannabis 
alcohol 


cannabis 
alcohol 


cannabis 
alcohol 


alcohol 


cannabis 
alcohol 
other drugs 


alcohol and other 
drugs 


cannabis 
alcohol 
other drugs 


cannabis 
other drugs 


Severity 


PU 


SUD 


PU 


PU 


PU 


PU 


SUD 


Ages 


[eligible] 


Mean 
(sd) 


(12, 18] 
15.9 (1) 


(12, 18] 
15.8 
(1.4) 


(12, 18] 
16.2 
(1.2) 


[14, 18] 
15.5 (1) 


(12, 18] 
15.6 
(1.3) 


13, 21] 
17.6 
(2.1) 


(14, 18] 
16.2 
(1.2) 


(13, 17] 
15.4 (1) 


Male 


% 


83 


89 


rhs) 


57 


70 


43 


59 


80 


Setting 


outpatient 
research clinic 


outpatient 
community 


outpatient 
research clinic 


outpatient 
research clinic 


outpatient 
community 
(juvenile 
justice 
family court) 


outpatient 
onlline 


outpatient 
school 


outpatient 
research clinic 


Intervention 
Delivery 


research staff 
(postdoctoral 
fellows, 
Master's level 
therapists) 


research staff 
(Master's level 
therapists) 


research staff 
(postdoctoral 
fellows) 


research staff 
(no detail) 


therapists (no 
detail) 


community 
Clinicians 


therapists (no 
detail) 


research staff 
(PhD 
psychologists, 
graduate 
students) 


Arm Names 


1 
CBT+MI+Fam[behavioral]+CM: 
“MET/CBT + abstinence CM + 
family management” 


2. CBT+MI+Educ+CM (parent): 
“METICBT + attendance CM + 
parent psychoeducation” 


1. CBT+MI+CM (parent): 
“MET/CBT+CM+Parent 
Training” 


2, CBT+MI+CM: 
“MET/CBT+abstinence-based 
contingency management 
(CM)’ 


3. CBT+MI: “Motivational 
enhancement 
therapy/cognitive-behavioral 
therapy (MET/CBT)” 


1; 
CBT+MI+Fam|[behavioral]+CM 
+ICM: “Experimental” 


2. CBT+MI+CM+ICM: 
“Contriol” 

1. TAU: “Information-only 
control” 

2. CBT+MI (group): “Learning 
to drink” 

1. Educ: “Adolescent-only 
health promotion intervention” 


2. CBT+Fam[behavioral]: 
“Family-based affect 
management” 


1. TAU: “Attention control” 


2. CBT: “Navigating my 
Journey” 


1. TAU: “Standard care” 


2. CBT+MI: “Guided self- 
change” 


1. Famf[functional]: “FFT” 
2. Educ (group): “Group” 


3. CBT+Ml+Famf[functional]: 
“Joint” 


4. CBT+MI: “CBT” 


Ages 


Author, Year Substances [eligible] Male Intervention 


PMID* N Used Severity Mean % Setting Delivery Arm Names 
(sd) 
Zhang, 2018 270 alcohol or other SUD (14, 20] 53 Outpatient Master's level 1. MI: “Motivational 
30556713 drugs 18.7 (drop-in center — (counelors, enhancement therapy” 
(1.3) for homeless marriage and 
youth) family 2. ICM: “Case management” 
therapists or 
social 3. CBT: “Community 
workers) reinforcement approach” 


PMID* = Pubmed identifier if available, otherwise (database name). Arm names = Intervention codes, (intervention modifiers) 
and [family subclassification]: "study arm name". Abbreviations: N=number randomized; SD = standard deviation; ED = 
emergency department; nr = not reported; CBT = cognitive behavioral therapy; CM = contingency management; Edu = 
education; Fam = family therapy; ICM = intensive case management; MI = motivational interviewing; TAU = treatment as usual; 
parent = at least one component of the intervention included parent involvement/was targeted towards parents; Fam = Family 
therapy; ICM= intensive case management; group = at least one component of the intervention was delivered in a group setting; 
parent = at least one component of the intervention included parent involvement/was targeted towards parents; integrated = 
intervention as a whole was designed to treat substance use disorder/problematic use and at least one other diagnoses (e.g., 
mental health); cultural = intervention designed to meet the unique characteristics of the population in which it was delivered. 
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Waldron, 2001 L U H HU L UH = ilk, 1 -. cE No 
11680557 
Walker, 2006 U U H HU L U HU LU L No 
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Walker, 2011 L bLoeH H #H LU fp Ee oe No 
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Random sequence generation (selection bias): Selection bias (biased allocation to interventions) due to inadequate generation of a 
randomized sequence; Allocation concealment (selection bias): Selection bias (biased allocation to interventions) due to 
inadequate concealment of allocations prior to assignment; Blinding of participants (performance bias): Performance bias due to 
knowledge of the allocated interventions by participants during the study; Blinding of personnel/ care providers (performance 
bias): Performance bias due to knowledge of the allocated interventions by personnel/care providers during the study; Blinding of 


H-7 


outcome assessor (detection bias): Detection bias due to knowledge of the allocated interventions by outcome assessors; 
Incomplete outcome data (attrition bias): Attrition bias due to amount, nature or handling of incomplete outcome data; Intention- 
to-treat-analysis: Bias due to incomplete reporting and analysis according to group allocation; Group similarity at baseline 
(selection bias): Selection bias due to dissimilarity at baseline for the most important prognostic indicators; Co-interventions 
(performance bias): Performance bias because co-interventions were different across groups; Compliance (performance bias): 
Performance bias due to inappropriate compliance with interventions across groups; Timing of outcome assessments (detection 
bias): Detection bias because important outcomes were not measured at the same time across groups; Additional Bias: Bias due 
to problems not covered elsewhere in the table; Abbreviations: H=high risk of bias; U = unclear risk of bias; L = low risk of bias 


Appendix I. Technical Appendix 


TA Trikalinos, DW Steele 


Network Meta-analysis Models 


We provide a detailed description of the models used in the main analysis. 


Notation 


Let k = 1,...,K index studies and (j = 1,...,J) index treatments in a network meta- 
analysis. For continuous outcomes, write x,; for the mean and Oi; for the conditional 
(sampling) variance of the responses with treatment j in trial k.+ 


For dichotomous outcomes, write Tx; for the number of people with events and N;,; for the 
total number of people who received treatment j in trial k. 


Encode what treatment was assigned in an arm in a trial using the (J — 1)-long row vector 
(0,..., 15,0) iff <J 


a Vo ...,0) ey. Ay 


where has 1, ;; means ‘1 at the j-th position’. This can be used as a row in a design matrix 
encoded such that treatment J is the reference treatment. 


Model 


Network meta-analysis is mathematically equivalent to a 2-level hierarchical model. 


Observational Part 


The first level (observational part) models the conditional distribution of data within each 
trial. For continuous outcomes, write: 


Xnj ~ N(uxj, o%;) (2) 
Meg = TyjSx +O, (3) 


where 8x = (6x1, +», 5x71) is a column vector of basic parameters, a; is a study-specific 
intercept, and ’ denotes transpose. The a, can be interpreted as the mean of the 


1 If trial k compares a strict subset of the J treatments, say j;, j2, and j3, 7 € {Jj1,J2,J3} = 


Jp & £1,2,... JR = J. 
I-1 


outcome under treatment j. Each 6,; can be interpreted as the difference in the mean of 
the outcome between treatment j < J and treatment / in study k. 


For dichotomous outcomes (2) and (3) become: 


Vj oe Bin(1,;, Nj) (4) 
fie = logit(,;) (5) 
= Tj 5x + Ak, (6) 


where now the a; can be interpreted as the log-odds of the probability of the outcome 
under treatment J. Each 6;; can be interpreted as the difference in the log-odds of the 
probability of the outcome between treatment j < J and treatment J in study k. 


The model in (3) (or in (6) for dichotomous outcomes) explicitly encodes a consistency 
assumption between direct and indirect effects. 


Structural Part 


The structural part of the model prescribes how the study-specific parameters are 
related. 


The Intercepts a; 


We modeled the intercepts as fixed constants. 


The Treatment Effects 8; 
We considered two variants. 
1. Under an equal effect model 
6, = 5, 


2. for all k. In this case the hierarchical model degenerates to a heteroskedastic 
regression model. 


3. Under a random effects model, treatment-specific effects are modeled with a 
multivariate normal distribution 


5, ~ N(8,2), 


* Model (3) reduces the number of treatment effects in the network’s graph from |E| > 
J —1tothe J — 1 in &,. All other effects are recovered as convex combinations of the 
elements of 5;. 


1-2 


4. where & = (6;,...,5)_1)’ is a column vector of between-study means and covariance 
matrix 


a 
5. In(9), Q is a square correlation matrix. tT? is a between-study variance parameter 
which we assume to be the same for all treatment effects. This homogeneity of 
variances assumption is commonly employed. The homogeneity of variances 


assumption together with (3) or (6) imply that © has a compound-symmetry structure 
with all off-diagonal elements equal to 0.5 and all diagonal elements equal to 1.° 


Comparison of Direct and Indirect Estimates of an Effect 


Consider a network with J + 1 treatments, where treatment j in the set of studies that 
include a comparison of interest (say, j vs. i) is considered as j*. Implementing the models 
previously described, the direct estimate for the comparison of interest is then the 
contrast between treatment j* and treatment i, and the indirect estimate is the contrast 
between treatment j and treatment i. The consistency factor is then the contrast 
between treatment j* and j. 


Computation 


We fit models with gemtc, which uses rjags in R and JAGS for the Bayesian computation. 
Graph operations were done with igraph in R. 


3 To show, start from (3) (equivalently, from (6) for dichotomous outcomes) and take 
variances. 


1-3 


